2026-02-17T12:10:42.717 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T12:10:42.733 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:10:42.809 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51426 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51426' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - CEPHADM_FAILED_DAEMON log-only-match: - CEPHADM_ sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2M4/zYbvyOBPuIltH3JeIZ/xwRr54PayktLXNIWw76KfXHppuW/QBVu27KLzAZrYFFNHntx9GxQoC/LiMiJH8= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - install: null - cephadm: null - cephadm.shell: host.a: - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - workunit: clients: client.0: - cephadm/test_iscsi_pids_limit.sh - cephadm/test_iscsi_etc_hosts.sh - cephadm/test_iscsi_setup.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T12:10:42.809 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T12:10:42.810 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T12:10:42.810 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T12:10:42.812 INFO:teuthology.task.internal:Checking packages... 2026-02-17T12:10:42.812 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T12:10:42.812 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T12:10:42.812 INFO:teuthology.packaging:ref: None 2026-02-17T12:10:42.812 INFO:teuthology.packaging:tag: None 2026-02-17T12:10:42.812 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:10:42.812 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:10:42.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:10:42.937 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T12:10:42.938 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T12:10:42.950 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T12:10:42.950 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T12:10:42.964 INFO:teuthology.task.internal:Saving configuration 2026-02-17T12:10:42.973 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T12:10:42.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T12:10:43.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial162.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51426', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 12:07:15.033430', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2M4/zYbvyOBPuIltH3JeIZ/xwRr54PayktLXNIWw76KfXHppuW/QBVu27KLzAZrYFFNHntx9GxQoC/LiMiJH8='} 2026-02-17T12:10:43.065 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T12:10:43.077 INFO:teuthology.task.internal:roles: ubuntu@trial162.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2026-02-17T12:10:43.077 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T12:10:43.161 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x735d51fc3ec0>, signals=[15]) 2026-02-17T12:10:43.161 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T12:10:43.171 INFO:teuthology.task.internal:Opening connections... 2026-02-17T12:10:43.171 DEBUG:teuthology.task.internal:connecting to ubuntu@trial162.front.sepia.ceph.com 2026-02-17T12:10:43.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:10:43.233 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T12:10:43.245 DEBUG:teuthology.orchestra.run.trial162:> uname -m 2026-02-17T12:10:43.307 INFO:teuthology.orchestra.run.trial162.stdout:x86_64 2026-02-17T12:10:43.307 DEBUG:teuthology.orchestra.run.trial162:> cat /etc/os-release 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:NAME="CentOS Stream" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:VERSION="9" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:ID="centos" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:ID_LIKE="rhel fedora" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:VERSION_ID="9" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:PLATFORM_ID="platform:el9" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:ANSI_COLOR="0;31" 2026-02-17T12:10:43.363 INFO:teuthology.orchestra.run.trial162.stdout:LOGO="fedora-logo-icon" 2026-02-17T12:10:43.364 INFO:teuthology.orchestra.run.trial162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T12:10:43.364 INFO:teuthology.orchestra.run.trial162.stdout:HOME_URL="https://centos.org/" 2026-02-17T12:10:43.364 INFO:teuthology.orchestra.run.trial162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T12:10:43.364 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T12:10:43.364 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T12:10:43.364 INFO:teuthology.lock.ops:Updating trial162.front.sepia.ceph.com on lock server 2026-02-17T12:10:43.450 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T12:10:43.468 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T12:10:43.480 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T12:10:43.480 DEBUG:teuthology.orchestra.run.trial162:> test '!' -e /home/ubuntu/cephtest 2026-02-17T12:10:43.494 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T12:10:43.505 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T12:10:43.506 DEBUG:teuthology.orchestra.run.trial162:> test -z $(ls -A /var/lib/ceph) 2026-02-17T12:10:43.551 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T12:10:43.655 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T12:10:43.678 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T12:10:43.678 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T12:10:43.679 DEBUG:teuthology.orchestra.run.trial162:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T12:10:43.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:10:43.694 DEBUG:teuthology.orchestra.run.trial162:> uname -r 2026-02-17T12:10:43.749 INFO:teuthology.orchestra.run.trial162.stdout:5.14.0-645.el9.x86_64 2026-02-17T12:10:43.749 INFO:teuthology.task.kernel:Running kernel on trial162: 5.14.0-645.el9.x86_64 2026-02-17T12:10:43.749 DEBUG:teuthology.orchestra.run.trial162:> sudo yum install -y kernel 2026-02-17T12:10:48.222 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.9 MB 00:04 2026-02-17T12:10:49.097 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - AppStream 77 MB/s | 27 MB 00:00 2026-02-17T12:10:52.752 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 7.8 MB 00:01 2026-02-17T12:10:53.565 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - Extras packages 225 kB/s | 20 kB 00:00 2026-02-17T12:10:54.112 INFO:teuthology.orchestra.run.trial162.stdout:Extra Packages for Enterprise Linux 43 MB/s | 20 MB 00:00 2026-02-17T12:10:57.311 INFO:teuthology.orchestra.run.trial162.stdout:lab-extras 1.2 MB/s | 50 kB 00:00 2026-02-17T12:10:58.329 INFO:teuthology.orchestra.run.trial162.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T12:10:58.349 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:10:58.350 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:10:58.350 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T12:10:58.350 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:10:58.350 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:10:58.350 INFO:teuthology.orchestra.run.trial162.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T12:10:58.350 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T12:10:58.350 INFO:teuthology.orchestra.run.trial162.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout:Install 4 Packages 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 88 M 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 135 M 2026-02-17T12:10:58.351 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:10:58.540 INFO:teuthology.orchestra.run.trial162.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 6.0 MB/s | 803 kB 00:00 2026-02-17T12:10:58.684 INFO:teuthology.orchestra.run.trial162.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 62 MB/s | 17 MB 00:00 2026-02-17T12:10:58.835 INFO:teuthology.orchestra.run.trial162.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 105 MB/s | 31 MB 00:00 2026-02-17T12:10:59.172 INFO:teuthology.orchestra.run.trial162.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 52 MB/s | 40 MB 00:00 2026-02-17T12:10:59.172 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:10:59.172 INFO:teuthology.orchestra.run.trial162.stdout:Total 107 MB/s | 88 MB 00:00 2026-02-17T12:10:59.361 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:10:59.566 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:10:59.566 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:10:59.913 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:10:59.913 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:11:01.005 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:11:01.289 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T12:11:01.308 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:11:03.099 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:11:03.127 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:11:06.148 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:11:06.155 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:11:09.191 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:11:39.470 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:11:39.490 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:11:39.555 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:11:39.555 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T12:11:39.555 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:11:39.555 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:11:39.606 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:11:39.666 DEBUG:teuthology.orchestra.run.trial162:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T12:11:39.693 INFO:teuthology.orchestra.run.trial162.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T12:11:39.693 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T12:11:39.693 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T12:11:39.694 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T12:11:39.694 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T12:11:39.694 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-17T12:11:39.694 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial162.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T12:11:39.694 DEBUG:teuthology.orchestra.run.trial162:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T12:11:39.757 INFO:teuthology.orchestra.run.trial162.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T12:11:39.758 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T12:11:39.759 DEBUG:teuthology.orchestra.run.trial162:> sudo rpm -qi grub2-tools 2026-02-17T12:11:39.827 INFO:teuthology.orchestra.run.trial162.stdout:Name : grub2-tools 2026-02-17T12:11:39.827 INFO:teuthology.orchestra.run.trial162.stdout:Epoch : 1 2026-02-17T12:11:39.827 INFO:teuthology.orchestra.run.trial162.stdout:Version : 2.06 2026-02-17T12:11:39.827 INFO:teuthology.orchestra.run.trial162.stdout:Release : 118.el9 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Architecture: x86_64 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Group : Unspecified 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Size : 8393909 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:License : GPLv3+ 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Packager : builder@centos.org 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:Vendor : CentOS 2026-02-17T12:11:39.828 INFO:teuthology.orchestra.run.trial162.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout:Summary : Support tools for GRUB. 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout:Description : 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout:hardware devices. 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:11:39.829 INFO:teuthology.orchestra.run.trial162.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T12:11:39.831 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T12:11:39.831 INFO:teuthology.task.kernel:Updating grub on trial162 to boot 5.14.0-681.el9.x86_64 2026-02-17T12:11:39.831 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T12:11:39.894 INFO:teuthology.orchestra.run.trial162.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T12:11:39.895 DEBUG:teuthology.orchestra.run.trial162:> sudo command -v grubby && echo yes || echo no 2026-02-17T12:11:39.958 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/grubby 2026-02-17T12:11:39.960 INFO:teuthology.orchestra.run.trial162.stdout:yes 2026-02-17T12:11:39.960 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T12:11:40.024 INFO:teuthology.orchestra.run.trial162.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T12:11:40.025 DEBUG:teuthology.orchestra.run.trial162:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T12:11:40.097 DEBUG:teuthology.orchestra.run.trial162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T12:11:40.301 INFO:teuthology.orchestra.run.trial162.stderr:Generating grub configuration file ... 2026-02-17T12:11:40.364 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T12:11:40.370 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T12:11:40.619 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T12:11:40.625 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T12:11:40.656 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T12:11:40.663 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T12:11:40.686 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T12:11:40.693 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T12:11:40.773 INFO:teuthology.orchestra.run.trial162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T12:11:40.781 INFO:teuthology.orchestra.run.trial162.stderr:done 2026-02-17T12:11:40.783 DEBUG:teuthology.orchestra.run.trial162:> test -d /sys/firmware/efi 2026-02-17T12:11:40.798 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T12:11:40.863 INFO:teuthology.orchestra.run.trial162.stdout:/boot/efi/EFI/BOOT 2026-02-17T12:11:40.863 INFO:teuthology.orchestra.run.trial162.stdout:/boot/efi/EFI/centos 2026-02-17T12:11:40.865 DEBUG:teuthology.orchestra.run.trial162:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T12:11:40.931 INFO:teuthology.orchestra.run.trial162.stdout:no 2026-02-17T12:11:40.931 DEBUG:teuthology.orchestra.run.trial162:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T12:11:40.997 INFO:teuthology.orchestra.run.trial162.stdout:yes 2026-02-17T12:11:40.997 DEBUG:teuthology.orchestra.run.trial162:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T12:11:41.063 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial162 2026-02-17T12:11:41.064 DEBUG:teuthology.orchestra.run.trial162:> sudo bash -c ' 2026-02-17T12:11:41.064 DEBUG:teuthology.orchestra.run.trial162:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T12:11:41.064 DEBUG:teuthology.orchestra.run.trial162:> ' 2026-02-17T12:12:11.106 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-17T12:12:11.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T12:12:11.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:13:11.168 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T12:13:20.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T12:13:20.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:13:20.312 DEBUG:teuthology.orchestra.run.trial162:> true 2026-02-17T12:13:20.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T12:13:20.471 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T12:13:20.471 DEBUG:teuthology.orchestra.run.trial162:> uname -r 2026-02-17T12:13:20.526 INFO:teuthology.orchestra.run.trial162.stdout:5.14.0-681.el9.x86_64 2026-02-17T12:13:20.526 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T12:13:20.526 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T12:13:20.526 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T12:13:21.527 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-17T12:13:21.528 DEBUG:teuthology.orchestra.run.trial162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T12:13:21.556 INFO:teuthology.orchestra.run.trial162.stdout:ttyS1 2026-02-17T12:13:21.578 DEBUG:teuthology.parallel:result is None 2026-02-17T12:13:21.578 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T12:13:21.587 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T12:13:21.587 DEBUG:teuthology.orchestra.run.trial162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T12:13:21.634 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T12:13:21.645 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T12:13:21.658 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T12:13:21.658 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T12:13:21.697 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T12:13:21.713 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T12:13:21.714 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T12:13:21.758 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:13:21.766 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:13:21.768 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T12:13:21.783 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T12:13:21.784 DEBUG:teuthology.orchestra.run.trial162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T12:13:21.831 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T12:13:21.844 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T12:13:21.844 DEBUG:teuthology.orchestra.run.trial162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T12:13:21.888 DEBUG:teuthology.orchestra.run.trial162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:13:22.052 DEBUG:teuthology.orchestra.run.trial162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:13:22.077 DEBUG:teuthology.orchestra.run.trial162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:13:22.229 DEBUG:teuthology.orchestra.run.trial162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:13:22.253 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:13:22.253 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T12:13:22.318 DEBUG:teuthology.orchestra.run.trial162:> sudo service rsyslog restart 2026-02-17T12:13:22.387 INFO:teuthology.orchestra.run.trial162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:13:22.747 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T12:13:22.758 INFO:teuthology.task.internal:Starting timer... 2026-02-17T12:13:22.758 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T12:13:22.777 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T12:13:22.792 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-17T12:13:22.792 DEBUG:teuthology.orchestra.run.trial162:> sudo service auditd rotate 2026-02-17T12:13:22.820 INFO:teuthology.orchestra.run.trial162.stdout:Rotating logs: 2026-02-17T12:13:22.822 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T12:13:22.822 DEBUG:teuthology.orchestra.run.trial162:> /usr/sbin/getenforce 2026-02-17T12:13:22.880 INFO:teuthology.orchestra.run.trial162.stdout:Permissive 2026-02-17T12:13:22.880 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial162.front.sepia.ceph.com': 'permissive'} 2026-02-17T12:13:22.881 DEBUG:teuthology.orchestra.run.trial162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:13:22.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:13:22.945 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T12:13:22.945 DEBUG:teuthology.orchestra.run.trial162:> sudo /usr/sbin/setenforce permissive 2026-02-17T12:13:23.009 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T12:13:23.025 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T12:13:23.038 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T12:13:23.040 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T12:16:06.136 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial162.front.sepia.ceph.com')] 2026-02-17T12:16:06.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T12:16:06.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:16:06.218 DEBUG:teuthology.orchestra.run.trial162:> true 2026-02-17T12:16:06.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-17T12:16:06.293 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T12:16:06.302 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T12:16:06.302 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T12:16:06.303 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:16:06.360 INFO:teuthology.orchestra.run.trial162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T12:16:06.371 INFO:teuthology.orchestra.run.trial162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T12:16:06.391 INFO:teuthology.orchestra.run.trial162.stderr:sudo: ntpd: command not found 2026-02-17T12:16:06.401 INFO:teuthology.orchestra.run.trial162.stdout:506 Cannot talk to daemon 2026-02-17T12:16:06.412 INFO:teuthology.orchestra.run.trial162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T12:16:06.423 INFO:teuthology.orchestra.run.trial162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T12:16:06.474 INFO:teuthology.orchestra.run.trial162.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:16:06.665 INFO:teuthology.orchestra.run.trial162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:16:06.665 INFO:teuthology.orchestra.run.trial162.stdout:=============================================================================== 2026-02-17T12:16:06.665 INFO:teuthology.orchestra.run.trial162.stdout:^? 107-172-222-7-host.coloc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:16:06.665 INFO:teuthology.orchestra.run.trial162.stdout:^? 172-104-28-175.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:16:06.665 INFO:teuthology.orchestra.run.trial162.stdout:^? frumentum-zeus.infra.fru> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:16:06.665 INFO:teuthology.orchestra.run.trial162.stdout:^? time7.beanman.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:16:06.667 INFO:teuthology.run_tasks:Running task pexec... 2026-02-17T12:16:06.684 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-17T12:16:06.685 DEBUG:teuthology.orchestra.run.trial162:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T12:16:06.711 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial162.front.sepia.ceph.com 2026-02-17T12:16:06.711 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T12:16:06.711 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-02-17T12:16:06.711 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-02-17T12:16:06.711 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-02-17T12:16:06.881 INFO:teuthology.orchestra.run.trial162.stdout:No match for argument: nvme-cli 2026-02-17T12:16:06.881 INFO:teuthology.orchestra.run.trial162.stderr:No packages marked for removal. 2026-02-17T12:16:06.884 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:16:06.884 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:16:06.884 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:16:07.187 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 12:15:39 PM UTC. 2026-02-17T12:16:07.269 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:16:07.269 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout: runc x86_64 4:1.4.0-1.el9 appstream 4.0 M 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout:Upgrading: 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T12:16:07.270 INFO:teuthology.orchestra.run.trial162.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout:Install 7 Packages 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout:Upgrade 1 Package 2026-02-17T12:16:07.271 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:16:07.272 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 6.4 M 2026-02-17T12:16:07.272 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:16:07.526 INFO:teuthology.orchestra.run.trial162.stdout:(1/8): nvmetcli-0.8-3.el9.noarch.rpm 414 kB/s | 44 kB 00:00 2026-02-17T12:16:07.534 INFO:teuthology.orchestra.run.trial162.stdout:(2/8): python3-configshell-1.1.30-1.el9.noarch. 634 kB/s | 72 kB 00:00 2026-02-17T12:16:07.588 INFO:teuthology.orchestra.run.trial162.stdout:(3/8): python3-kmod-0.9-32.el9.x86_64.rpm 1.3 MB/s | 84 kB 00:00 2026-02-17T12:16:07.600 INFO:teuthology.orchestra.run.trial162.stdout:(4/8): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.2 MB/s | 150 kB 00:00 2026-02-17T12:16:07.653 INFO:teuthology.orchestra.run.trial162.stdout:(5/8): nvme-cli-2.16-1.el9.x86_64.rpm 5.0 MB/s | 1.2 MB 00:00 2026-02-17T12:16:07.683 INFO:teuthology.orchestra.run.trial162.stdout:(6/8): libnvme-1.16.1-2.el9.x86_64.rpm 3.8 MB/s | 116 kB 00:00 2026-02-17T12:16:07.698 INFO:teuthology.orchestra.run.trial162.stdout:(7/8): python3-urwid-2.1.2-4.el9.x86_64.rpm 7.4 MB/s | 837 kB 00:00 2026-02-17T12:16:07.763 INFO:teuthology.orchestra.run.trial162.stdout:(8/8): runc-1.4.0-1.el9.x86_64.rpm 24 MB/s | 4.0 MB 00:00 2026-02-17T12:16:07.763 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:16:07.763 INFO:teuthology.orchestra.run.trial162.stdout:Total 13 MB/s | 6.4 MB 00:00 2026-02-17T12:16:07.841 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:16:07.848 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:16:07.848 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:16:07.912 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:16:07.912 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:16:07.996 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:16:08.064 INFO:teuthology.orchestra.run.trial162.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/9 2026-02-17T12:16:08.070 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/9 2026-02-17T12:16:08.079 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/9 2026-02-17T12:16:08.087 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/9 2026-02-17T12:16:08.092 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/9 2026-02-17T12:16:08.093 INFO:teuthology.orchestra.run.trial162.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/9 2026-02-17T12:16:08.221 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/9 2026-02-17T12:16:08.223 INFO:teuthology.orchestra.run.trial162.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/9 2026-02-17T12:16:08.502 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/9 2026-02-17T12:16:08.502 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T12:16:08.502 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:16:08.540 INFO:teuthology.orchestra.run.trial162.stdout: Installing : runc-4:1.4.0-1.el9.x86_64 8/9 2026-02-17T12:16:08.556 INFO:teuthology.orchestra.run.trial162.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 9/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 9/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/9 2026-02-17T12:16:08.793 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : runc-4:1.4.0-1.el9.x86_64 7/9 2026-02-17T12:16:08.794 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 8/9 2026-02-17T12:16:08.846 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libnvme-1.13-1.el9.x86_64 9/9 2026-02-17T12:16:08.846 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:16:08.846 INFO:teuthology.orchestra.run.trial162.stdout:Upgraded: 2026-02-17T12:16:08.846 INFO:teuthology.orchestra.run.trial162.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T12:16:08.846 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:16:08.846 INFO:teuthology.orchestra.run.trial162.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T12:16:08.846 INFO:teuthology.orchestra.run.trial162.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T12:16:08.847 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T12:16:08.847 INFO:teuthology.orchestra.run.trial162.stdout: runc-4:1.4.0-1.el9.x86_64 2026-02-17T12:16:08.847 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:16:08.847 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:16:08.897 DEBUG:teuthology.parallel:result is None 2026-02-17T12:16:08.897 INFO:teuthology.run_tasks:Running task install... 2026-02-17T12:16:08.909 DEBUG:teuthology.task.install:project ceph 2026-02-17T12:16:08.910 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T12:16:08.910 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T12:16:08.910 INFO:teuthology.task.install:Using flavor: default 2026-02-17T12:16:08.917 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T12:16:08.917 INFO:teuthology.task.install:extra packages: [] 2026-02-17T12:16:08.917 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T12:16:08.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:16:09.051 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T12:16:09.051 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T12:16:09.175 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T12:16:09.175 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:16:09.175 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T12:16:09.200 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T12:16:09.200 DEBUG:teuthology.orchestra.run.trial162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T12:16:09.265 DEBUG:teuthology.orchestra.run.trial162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T12:16:09.339 DEBUG:teuthology.orchestra.run.trial162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T12:16:09.402 INFO:teuthology.orchestra.run.trial162.stdout:check_obsoletes = 1 2026-02-17T12:16:09.404 DEBUG:teuthology.orchestra.run.trial162:> sudo yum clean all 2026-02-17T12:16:09.552 INFO:teuthology.orchestra.run.trial162.stdout:41 files removed 2026-02-17T12:16:09.566 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-radosgw 2026-02-17T12:16:09.862 INFO:teuthology.orchestra.run.trial162.stdout:ceph packages for x86_64 570 kB/s | 86 kB 00:00 2026-02-17T12:16:09.995 INFO:teuthology.orchestra.run.trial162.stdout:ceph noarch packages 111 kB/s | 12 kB 00:00 2026-02-17T12:16:10.133 INFO:teuthology.orchestra.run.trial162.stdout:ceph source packages 16 kB/s | 1.9 kB 00:00 2026-02-17T12:16:10.476 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - BaseOS 28 MB/s | 8.9 MB 00:00 2026-02-17T12:16:39.754 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - AppStream 955 kB/s | 27 MB 00:28 2026-02-17T12:16:50.974 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - CRB 901 kB/s | 7.8 MB 00:08 2026-02-17T12:16:51.933 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 20 kB 00:00 2026-02-17T12:17:09.975 INFO:teuthology.orchestra.run.trial162.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 20 MB 00:17 2026-02-17T12:17:13.184 INFO:teuthology.orchestra.run.trial162.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-17T12:17:14.393 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:17:14.394 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:17:14.394 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout:Upgrading: 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T12:17:14.395 INFO:teuthology.orchestra.run.trial162.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T12:17:14.396 INFO:teuthology.orchestra.run.trial162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T12:17:14.397 INFO:teuthology.orchestra.run.trial162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout:Installing weak dependencies: 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout:Install 32 Packages 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout:Upgrade 2 Packages 2026-02-17T12:17:14.398 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:14.399 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 62 M 2026-02-17T12:17:14.399 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:17:14.930 INFO:teuthology.orchestra.run.trial162.stdout:(1/34): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T12:17:14.973 INFO:teuthology.orchestra.run.trial162.stdout:(2/34): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 584 kB/s | 25 kB 00:00 2026-02-17T12:17:15.035 INFO:teuthology.orchestra.run.trial162.stdout:(3/34): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 16 MB/s | 999 kB 00:00 2026-02-17T12:17:15.089 INFO:teuthology.orchestra.run.trial162.stdout:(4/34): libradosstriper1-19.2.3-675.g3c96dfb3.e 9.1 MB/s | 503 kB 00:00 2026-02-17T12:17:15.186 INFO:teuthology.orchestra.run.trial162.stdout:(5/34): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T12:17:15.238 INFO:teuthology.orchestra.run.trial162.stdout:(6/34): python3-ceph-argparse-19.2.3-675.g3c96d 861 kB/s | 45 kB 00:00 2026-02-17T12:17:15.291 INFO:teuthology.orchestra.run.trial162.stdout:(7/34): python3-ceph-common-19.2.3-675.g3c96dfb 2.6 MB/s | 142 kB 00:00 2026-02-17T12:17:15.322 INFO:teuthology.orchestra.run.trial162.stdout:(8/34): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-17T12:17:15.343 INFO:teuthology.orchestra.run.trial162.stdout:(9/34): python3-cephfs-19.2.3-675.g3c96dfb3.el9 3.2 MB/s | 165 kB 00:00 2026-02-17T12:17:15.359 INFO:teuthology.orchestra.run.trial162.stdout:(10/34): python3-rados-19.2.3-675.g3c96dfb3.el9 8.5 MB/s | 322 kB 00:00 2026-02-17T12:17:15.383 INFO:teuthology.orchestra.run.trial162.stdout:(11/34): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 7.4 MB/s | 303 kB 00:00 2026-02-17T12:17:15.395 INFO:teuthology.orchestra.run.trial162.stdout:(12/34): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 2.7 MB/s | 100 kB 00:00 2026-02-17T12:17:15.485 INFO:teuthology.orchestra.run.trial162.stdout:(13/34): ceph-common-19.2.3-675.g3c96dfb3.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T12:17:15.485 INFO:teuthology.orchestra.run.trial162.stdout:(14/34): mailcap-2.1.49-5.el9.noarch.rpm 325 kB/s | 33 kB 00:00 2026-02-17T12:17:15.506 INFO:teuthology.orchestra.run.trial162.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 843 kB/s | 93 kB 00:00 2026-02-17T12:17:15.531 INFO:teuthology.orchestra.run.trial162.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 2.2 MB/s | 104 kB 00:00 2026-02-17T12:17:15.534 INFO:teuthology.orchestra.run.trial162.stdout:(17/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.5 MB/s | 160 kB 00:00 2026-02-17T12:17:15.539 INFO:teuthology.orchestra.run.trial162.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 3.0 MB/s | 164 kB 00:00 2026-02-17T12:17:15.555 INFO:teuthology.orchestra.run.trial162.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.9 MB/s | 45 kB 00:00 2026-02-17T12:17:15.560 INFO:teuthology.orchestra.run.trial162.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 25 MB/s | 662 kB 00:00 2026-02-17T12:17:15.566 INFO:teuthology.orchestra.run.trial162.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 11 MB/s | 292 kB 00:00 2026-02-17T12:17:15.581 INFO:teuthology.orchestra.run.trial162.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 9.2 MB/s | 240 kB 00:00 2026-02-17T12:17:15.584 INFO:teuthology.orchestra.run.trial162.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.6 MB/s | 37 kB 00:00 2026-02-17T12:17:15.590 INFO:teuthology.orchestra.run.trial162.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.7 MB/s | 66 kB 00:00 2026-02-17T12:17:15.753 INFO:teuthology.orchestra.run.trial162.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 152 kB/s | 25 kB 00:00 2026-02-17T12:17:15.829 INFO:teuthology.orchestra.run.trial162.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 643 kB/s | 49 kB 00:00 2026-02-17T12:17:15.873 INFO:teuthology.orchestra.run.trial162.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-17T12:17:15.885 INFO:teuthology.orchestra.run.trial162.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2026-02-17T12:17:15.977 INFO:teuthology.orchestra.run.trial162.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2026-02-17T12:17:15.987 INFO:teuthology.orchestra.run.trial162.stdout:(30/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.2 MB/s | 838 kB 00:00 2026-02-17T12:17:16.019 INFO:teuthology.orchestra.run.trial162.stdout:(31/34): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-17T12:17:16.132 INFO:teuthology.orchestra.run.trial162.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2026-02-17T12:17:16.207 INFO:teuthology.orchestra.run.trial162.stdout:(33/34): librados2-19.2.3-675.g3c96dfb3.el9.x86 16 MB/s | 3.4 MB 00:00 2026-02-17T12:17:16.225 INFO:teuthology.orchestra.run.trial162.stdout:(34/34): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 15 MB/s | 3.2 MB 00:00 2026-02-17T12:17:16.229 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:17:16.230 INFO:teuthology.orchestra.run.trial162.stdout:Total 34 MB/s | 62 MB 00:01 2026-02-17T12:17:16.316 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:17:16.334 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:17:16.334 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:17:16.565 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:17:16.565 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:17:16.851 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:17:16.860 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-17T12:17:16.862 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-17T12:17:16.874 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-17T12:17:17.025 INFO:teuthology.orchestra.run.trial162.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-17T12:17:17.031 INFO:teuthology.orchestra.run.trial162.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:17:17.058 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:17:17.100 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/36 2026-02-17T12:17:17.101 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:17:17.111 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:17:17.115 INFO:teuthology.orchestra.run.trial162.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-17T12:17:17.124 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/36 2026-02-17T12:17:17.146 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/36 2026-02-17T12:17:17.147 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:17:17.161 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:17:17.194 INFO:teuthology.orchestra.run.trial162.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-17T12:17:17.197 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-17T12:17:17.203 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-17T12:17:17.205 INFO:teuthology.orchestra.run.trial162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-17T12:17:17.208 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-17T12:17:17.213 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-17T12:17:17.353 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-17T12:17:17.354 INFO:teuthology.orchestra.run.trial162.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/36 2026-02-17T12:17:17.379 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/36 2026-02-17T12:17:17.381 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/36 2026-02-17T12:17:17.387 INFO:teuthology.orchestra.run.trial162.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-17T12:17:17.612 INFO:teuthology.orchestra.run.trial162.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-17T12:17:17.613 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/36 2026-02-17T12:17:17.629 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/36 2026-02-17T12:17:17.632 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/36 2026-02-17T12:17:17.636 INFO:teuthology.orchestra.run.trial162.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-17T12:17:17.639 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-17T12:17:17.639 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T12:17:17.657 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T12:17:17.659 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-17T12:17:17.686 INFO:teuthology.orchestra.run.trial162.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-17T12:17:17.687 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 30/36 2026-02-17T12:17:18.673 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:17:18.675 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:17:18.957 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:17:18.960 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/36 2026-02-17T12:17:18.999 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/36 2026-02-17T12:17:18.999 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T12:17:18.999 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T12:17:18.999 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:19.002 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:17:23.434 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /sys 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /proc 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /mnt 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /var/tmp 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /home 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /root 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /tmp 2026-02-17T12:17:23.435 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:23.891 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/36 2026-02-17T12:17:23.914 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/36 2026-02-17T12:17:23.915 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:17:23.915 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T12:17:23.915 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:17:23.915 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:17:23.915 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:23.916 INFO:teuthology.orchestra.run.trial162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T12:17:23.929 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T12:17:23.929 INFO:teuthology.orchestra.run.trial162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:17:23.984 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:17:23.984 INFO:teuthology.orchestra.run.trial162.stdout:Creating group 'qat' with GID 992. 2026-02-17T12:17:23.984 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:24.249 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/36 2026-02-17T12:17:24.250 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-17T12:17:24.251 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-17T12:17:24.252 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/36 2026-02-17T12:17:24.310 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:17:24.310 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:24.310 INFO:teuthology.orchestra.run.trial162.stdout:Upgraded: 2026-02-17T12:17:24.310 INFO:teuthology.orchestra.run.trial162.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.310 INFO:teuthology.orchestra.run.trial162.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.310 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:17:24.310 INFO:teuthology.orchestra.run.trial162.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T12:17:24.311 INFO:teuthology.orchestra.run.trial162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.312 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:24.313 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:17:24.352 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-test 2026-02-17T12:17:24.663 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:11 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:17:24.745 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T12:17:24.746 INFO:teuthology.orchestra.run.trial162.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout:Install 5 Packages 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 50 M 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 212 M 2026-02-17T12:17:24.747 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:17:25.182 INFO:teuthology.orchestra.run.trial162.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 487 kB/s | 163 kB 00:00 2026-02-17T12:17:25.849 INFO:teuthology.orchestra.run.trial162.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 233 kB/s | 233 kB 00:01 2026-02-17T12:17:26.092 INFO:teuthology.orchestra.run.trial162.stdout:(3/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 40 MB/s | 50 MB 00:01 2026-02-17T12:17:26.094 INFO:teuthology.orchestra.run.trial162.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 332 kB/s | 303 kB 00:00 2026-02-17T12:17:26.098 INFO:teuthology.orchestra.run.trial162.stdout:(5/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 255 kB/s | 64 kB 00:00 2026-02-17T12:17:26.100 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:17:26.100 INFO:teuthology.orchestra.run.trial162.stdout:Total 37 MB/s | 50 MB 00:01 2026-02-17T12:17:26.127 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:17:26.136 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:17:26.136 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:17:26.322 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:17:26.322 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:17:26.533 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:17:26.539 INFO:teuthology.orchestra.run.trial162.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T12:17:26.543 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T12:17:26.551 INFO:teuthology.orchestra.run.trial162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T12:17:26.551 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:17:28.889 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:17:28.908 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:17:29.122 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:17:29.123 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T12:17:29.123 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T12:17:29.123 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T12:17:29.123 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:29.176 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:17:29.207 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph 2026-02-17T12:17:29.516 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:16 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:17:29.600 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T12:17:29.603 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T12:17:29.604 INFO:teuthology.orchestra.run.trial162.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T12:17:29.605 INFO:teuthology.orchestra.run.trial162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T12:17:29.606 INFO:teuthology.orchestra.run.trial162.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T12:17:29.607 INFO:teuthology.orchestra.run.trial162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T12:17:29.608 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T12:17:29.609 INFO:teuthology.orchestra.run.trial162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout:Installing weak dependencies: 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T12:17:29.610 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout:Install 98 Packages 2026-02-17T12:17:29.611 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:17:29.612 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 95 M 2026-02-17T12:17:29.612 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 519 M 2026-02-17T12:17:29.612 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:17:30.232 INFO:teuthology.orchestra.run.trial162.stdout:(1/98): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 71 kB/s | 6.5 kB 00:00 2026-02-17T12:17:30.307 INFO:teuthology.orchestra.run.trial162.stdout:(2/98): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 6.5 MB/s | 1.1 MB 00:00 2026-02-17T12:17:30.323 INFO:teuthology.orchestra.run.trial162.stdout:(3/98): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-17T12:17:30.346 INFO:teuthology.orchestra.run.trial162.stdout:(4/98): ceph-grafana-dashboards-19.2.3-675.g3c9 1.3 MB/s | 31 kB 00:00 2026-02-17T12:17:30.370 INFO:teuthology.orchestra.run.trial162.stdout:(5/98): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 6.1 MB/s | 150 kB 00:00 2026-02-17T12:17:30.511 INFO:teuthology.orchestra.run.trial162.stdout:(6/98): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 27 MB/s | 3.8 MB 00:00 2026-02-17T12:17:30.793 INFO:teuthology.orchestra.run.trial162.stdout:(7/98): ceph-mgr-diskprediction-local-19.2.3-67 26 MB/s | 7.4 MB 00:00 2026-02-17T12:17:30.823 INFO:teuthology.orchestra.run.trial162.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 751 kB/s | 22 kB 00:00 2026-02-17T12:17:30.862 INFO:teuthology.orchestra.run.trial162.stdout:(9/98): ceph-mgr-modules-core-19.2.3-675.g3c96d 6.2 MB/s | 253 kB 00:00 2026-02-17T12:17:30.880 INFO:teuthology.orchestra.run.trial162.stdout:(10/98): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_ 7.3 MB/s | 4.7 MB 00:00 2026-02-17T12:17:30.910 INFO:teuthology.orchestra.run.trial162.stdout:(11/98): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T12:17:30.910 INFO:teuthology.orchestra.run.trial162.stdout:(12/98): ceph-prometheus-alerts-19.2.3-675.g3c9 554 kB/s | 17 kB 00:00 2026-02-17T12:17:30.911 INFO:teuthology.orchestra.run.trial162.stdout:(13/98): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 1.0 MB/s | 49 kB 00:00 2026-02-17T12:17:30.922 INFO:teuthology.orchestra.run.trial162.stdout:(14/98): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 24 MB/s | 299 kB 00:00 2026-02-17T12:17:30.940 INFO:teuthology.orchestra.run.trial162.stdout:(15/98): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 25 MB/s | 769 kB 00:00 2026-02-17T12:17:30.977 INFO:teuthology.orchestra.run.trial162.stdout:(16/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 740 kB/s | 40 kB 00:00 2026-02-17T12:17:31.006 INFO:teuthology.orchestra.run.trial162.stdout:(17/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.6 MB/s | 350 kB 00:00 2026-02-17T12:17:31.012 INFO:teuthology.orchestra.run.trial162.stdout:(18/98): libgfortran-11.5.0-14.el9.x86_64.rpm 22 MB/s | 794 kB 00:00 2026-02-17T12:17:31.031 INFO:teuthology.orchestra.run.trial162.stdout:(19/98): libquadmath-11.5.0-14.el9.x86_64.rpm 7.3 MB/s | 184 kB 00:00 2026-02-17T12:17:31.042 INFO:teuthology.orchestra.run.trial162.stdout:(20/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.4 MB/s | 253 kB 00:00 2026-02-17T12:17:31.042 INFO:teuthology.orchestra.run.trial162.stdout:(21/98): libconfig-1.7.2-9.el9.x86_64.rpm 708 kB/s | 72 kB 00:00 2026-02-17T12:17:31.059 INFO:teuthology.orchestra.run.trial162.stdout:(22/98): python3-cryptography-36.0.1-5.el9.x86_ 45 MB/s | 1.2 MB 00:00 2026-02-17T12:17:31.066 INFO:teuthology.orchestra.run.trial162.stdout:(23/98): python3-pycparser-2.20-6.el9.noarch.rp 5.5 MB/s | 135 kB 00:00 2026-02-17T12:17:31.068 INFO:teuthology.orchestra.run.trial162.stdout:(24/98): python3-ply-3.11-14.el9.noarch.rpm 4.0 MB/s | 106 kB 00:00 2026-02-17T12:17:31.084 INFO:teuthology.orchestra.run.trial162.stdout:(25/98): python3-requests-2.25.1-10.el9.noarch. 5.1 MB/s | 126 kB 00:00 2026-02-17T12:17:31.093 INFO:teuthology.orchestra.run.trial162.stdout:(26/98): python3-urllib3-1.26.5-7.el9.noarch.rp 8.0 MB/s | 218 kB 00:00 2026-02-17T12:17:31.096 INFO:teuthology.orchestra.run.trial162.stdout:(27/98): unzip-6.0-59.el9.x86_64.rpm 6.4 MB/s | 182 kB 00:00 2026-02-17T12:17:31.110 INFO:teuthology.orchestra.run.trial162.stdout:(28/98): zip-3.0-35.el9.x86_64.rpm 9.9 MB/s | 266 kB 00:00 2026-02-17T12:17:31.554 INFO:teuthology.orchestra.run.trial162.stdout:(29/98): flexiblas-3.0.4-9.el9.x86_64.rpm 64 kB/s | 30 kB 00:00 2026-02-17T12:17:31.559 INFO:teuthology.orchestra.run.trial162.stdout:(30/98): flexiblas-openblas-openmp-3.0.4-9.el9. 33 kB/s | 15 kB 00:00 2026-02-17T12:17:31.904 INFO:teuthology.orchestra.run.trial162.stdout:(31/98): lua-5.4.4-4.el9.x86_64.rpm 547 kB/s | 188 kB 00:00 2026-02-17T12:17:31.984 INFO:teuthology.orchestra.run.trial162.stdout:(32/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 573 kB/s | 246 kB 00:00 2026-02-17T12:17:32.006 INFO:teuthology.orchestra.run.trial162.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 412 kB/s | 42 kB 00:00 2026-02-17T12:17:33.242 INFO:teuthology.orchestra.run.trial162.stdout:(34/98): protobuf-3.14.0-17.el9.x86_64.rpm 832 kB/s | 1.0 MB 00:01 2026-02-17T12:17:35.110 INFO:teuthology.orchestra.run.trial162.stdout:(35/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 762 kB/s | 3.0 MB 00:04 2026-02-17T12:17:35.455 INFO:teuthology.orchestra.run.trial162.stdout:(36/98): python3-devel-3.9.25-2.el9.x86_64.rpm 709 kB/s | 244 kB 00:00 2026-02-17T12:17:35.801 INFO:teuthology.orchestra.run.trial162.stdout:(37/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 719 kB/s | 249 kB 00:00 2026-02-17T12:17:36.066 INFO:teuthology.orchestra.run.trial162.stdout:(38/98): python3-libstoragemgmt-1.10.1-1.el9.x8 667 kB/s | 177 kB 00:00 2026-02-17T12:17:37.545 INFO:teuthology.orchestra.run.trial162.stdout:(39/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 847 kB/s | 1.2 MB 00:01 2026-02-17T12:17:37.809 INFO:teuthology.orchestra.run.trial162.stdout:(40/98): python3-mako-1.1.4-6.el9.noarch.rpm 652 kB/s | 172 kB 00:00 2026-02-17T12:17:37.914 INFO:teuthology.orchestra.run.trial162.stdout:[MIRROR] python3-markupsafe-1.1.1-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-markupsafe-1.1.1-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:17:38.329 INFO:teuthology.orchestra.run.trial162.stdout:[MIRROR] python3-markupsafe-1.1.1-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-markupsafe-1.1.1-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:17:38.340 INFO:teuthology.orchestra.run.trial162.stdout:(41/98): python3-markupsafe-1.1.1-12.el9.x86_64 65 kB/s | 35 kB 00:00 2026-02-17T12:17:38.586 INFO:teuthology.orchestra.run.trial162.stdout:(42/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 820 kB/s | 5.3 MB 00:06 2026-02-17T12:17:38.690 INFO:teuthology.orchestra.run.trial162.stdout:[MIRROR] python3-numpy-f2py-1.23.5-2.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-numpy-f2py-1.23.5-2.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:17:38.690 INFO:teuthology.orchestra.run.trial162.stdout:[MIRROR] python3-numpy-1.23.5-2.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-numpy-1.23.5-2.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:17:39.040 INFO:teuthology.orchestra.run.trial162.stdout:[MIRROR] python3-numpy-f2py-1.23.5-2.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-numpy-f2py-1.23.5-2.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:17:39.043 INFO:teuthology.orchestra.run.trial162.stdout:[MIRROR] python3-numpy-1.23.5-2.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-numpy-1.23.5-2.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:17:39.062 INFO:teuthology.orchestra.run.trial162.stdout:(43/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 929 kB/s | 442 kB 00:00 2026-02-17T12:17:39.087 INFO:teuthology.orchestra.run.trial162.stdout:(44/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 8.2 MB/s | 6.1 MB 00:00 2026-02-17T12:17:39.585 INFO:teuthology.orchestra.run.trial162.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 147 kB/s | 77 kB 00:00 2026-02-17T12:17:39.851 INFO:teuthology.orchestra.run.trial162.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 350 kB/s | 267 kB 00:00 2026-02-17T12:17:39.852 INFO:teuthology.orchestra.run.trial162.stdout:(47/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 595 kB/s | 159 kB 00:00 2026-02-17T12:17:39.976 INFO:teuthology.orchestra.run.trial162.stdout:(48/98): python3-requests-oauthlib-1.3.0-12.el9 435 kB/s | 54 kB 00:00 2026-02-17T12:17:40.201 INFO:teuthology.orchestra.run.trial162.stdout:(49/98): python3-pyasn1-modules-0.4.8-6.el9.noa 795 kB/s | 279 kB 00:00 2026-02-17T12:17:40.303 INFO:teuthology.orchestra.run.trial162.stdout:(50/98): python3-babel-2.9.1-2.el9.noarch.rpm 865 kB/s | 6.0 MB 00:07 2026-02-17T12:17:40.305 INFO:teuthology.orchestra.run.trial162.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 403 kB/s | 42 kB 00:00 2026-02-17T12:17:40.488 INFO:teuthology.orchestra.run.trial162.stdout:(52/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 493 kB/s | 90 kB 00:00 2026-02-17T12:17:40.512 INFO:teuthology.orchestra.run.trial162.stdout:(53/98): lua-devel-5.4.4-4.el9.x86_64.rpm 949 kB/s | 22 kB 00:00 2026-02-17T12:17:40.538 INFO:teuthology.orchestra.run.trial162.stdout:(54/98): protobuf-compiler-3.14.0-17.el9.x86_64 32 MB/s | 862 kB 00:00 2026-02-17T12:17:40.568 INFO:teuthology.orchestra.run.trial162.stdout:(55/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 713 kB/s | 189 kB 00:00 2026-02-17T12:17:40.636 INFO:teuthology.orchestra.run.trial162.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 285 kB/s | 19 kB 00:00 2026-02-17T12:17:40.766 INFO:teuthology.orchestra.run.trial162.stdout:(57/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.4 MB/s | 551 kB 00:00 2026-02-17T12:17:40.793 INFO:teuthology.orchestra.run.trial162.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 967 kB/s | 151 kB 00:00 2026-02-17T12:17:40.910 INFO:teuthology.orchestra.run.trial162.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 252 kB/s | 29 kB 00:00 2026-02-17T12:17:40.987 INFO:teuthology.orchestra.run.trial162.stdout:(60/98): python3-asyncssh-2.13.2-5.el9.noarch.r 2.4 MB/s | 548 kB 00:00 2026-02-17T12:17:41.041 INFO:teuthology.orchestra.run.trial162.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 460 kB/s | 60 kB 00:00 2026-02-17T12:17:41.125 INFO:teuthology.orchestra.run.trial162.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 317 kB/s | 43 kB 00:00 2026-02-17T12:17:41.158 INFO:teuthology.orchestra.run.trial162.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 275 kB/s | 32 kB 00:00 2026-02-17T12:17:41.193 INFO:teuthology.orchestra.run.trial162.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 206 kB/s | 14 kB 00:00 2026-02-17T12:17:41.324 INFO:teuthology.orchestra.run.trial162.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 1.0 MB/s | 173 kB 00:00 2026-02-17T12:17:41.377 INFO:teuthology.orchestra.run.trial162.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2026-02-17T12:17:41.511 INFO:teuthology.orchestra.run.trial162.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 1.3 MB/s | 254 kB 00:00 2026-02-17T12:17:41.684 INFO:teuthology.orchestra.run.trial162.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 833 kB/s | 144 kB 00:00 2026-02-17T12:17:41.715 INFO:teuthology.orchestra.run.trial162.stdout:(69/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.0 MB/s | 2.0 MB 00:00 2026-02-17T12:17:41.844 INFO:teuthology.orchestra.run.trial162.stdout:(70/98): python3-influxdb-5.3.1-1.el9.noarch.rp 869 kB/s | 139 kB 00:00 2026-02-17T12:17:41.859 INFO:teuthology.orchestra.run.trial162.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 390 kB/s | 56 kB 00:00 2026-02-17T12:17:41.910 INFO:teuthology.orchestra.run.trial162.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 163 kB/s | 11 kB 00:00 2026-02-17T12:17:41.947 INFO:teuthology.orchestra.run.trial162.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 201 kB/s | 18 kB 00:00 2026-02-17T12:17:42.042 INFO:teuthology.orchestra.run.trial162.stdout:(74/98): python3-jaraco-context-6.0.1-3.el9.noa 206 kB/s | 20 kB 00:00 2026-02-17T12:17:42.090 INFO:teuthology.orchestra.run.trial162.stdout:(75/98): python3-jaraco-collections-3.0.0-8.el9 129 kB/s | 23 kB 00:00 2026-02-17T12:17:42.129 INFO:teuthology.orchestra.run.trial162.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 225 kB/s | 19 kB 00:00 2026-02-17T12:17:42.204 INFO:teuthology.orchestra.run.trial162.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 232 kB/s | 26 kB 00:00 2026-02-17T12:17:42.338 INFO:teuthology.orchestra.run.trial162.stdout:(78/98): python3-logutils-0.3.5-21.el9.noarch.r 344 kB/s | 46 kB 00:00 2026-02-17T12:17:42.390 INFO:teuthology.orchestra.run.trial162.stdout:(79/98): python3-kubernetes-26.1.0-3.el9.noarch 3.9 MB/s | 1.0 MB 00:00 2026-02-17T12:17:42.469 INFO:teuthology.orchestra.run.trial162.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 605 kB/s | 79 kB 00:00 2026-02-17T12:17:42.537 INFO:teuthology.orchestra.run.trial162.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 587 kB/s | 86 kB 00:00 2026-02-17T12:17:42.605 INFO:teuthology.orchestra.run.trial162.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 423 kB/s | 58 kB 00:00 2026-02-17T12:17:42.675 INFO:teuthology.orchestra.run.trial162.stdout:(83/98): python3-portend-3.1.0-2.el9.noarch.rpm 234 kB/s | 16 kB 00:00 2026-02-17T12:17:42.735 INFO:teuthology.orchestra.run.trial162.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2026-02-17T12:17:42.794 INFO:teuthology.orchestra.run.trial162.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 758 kB/s | 90 kB 00:00 2026-02-17T12:17:42.846 INFO:teuthology.orchestra.run.trial162.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 277 kB/s | 31 kB 00:00 2026-02-17T12:17:42.943 INFO:teuthology.orchestra.run.trial162.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 1.2 MB/s | 188 kB 00:00 2026-02-17T12:17:42.968 INFO:teuthology.orchestra.run.trial162.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 485 kB/s | 59 kB 00:00 2026-02-17T12:17:43.091 INFO:teuthology.orchestra.run.trial162.stdout:(89/98): python3-tempora-5.0.0-2.el9.noarch.rpm 292 kB/s | 36 kB 00:00 2026-02-17T12:17:43.100 INFO:teuthology.orchestra.run.trial162.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 795 kB/s | 125 kB 00:00 2026-02-17T12:17:43.236 INFO:teuthology.orchestra.run.trial162.stdout:(91/98): python3-typing-extensions-4.15.0-1.el9 597 kB/s | 86 kB 00:00 2026-02-17T12:17:43.273 INFO:teuthology.orchestra.run.trial162.stdout:(92/98): python3-webob-1.8.8-2.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2026-02-17T12:17:43.376 INFO:teuthology.orchestra.run.trial162.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 642 kB/s | 90 kB 00:00 2026-02-17T12:17:43.497 INFO:teuthology.orchestra.run.trial162.stdout:(94/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2026-02-17T12:17:43.505 INFO:teuthology.orchestra.run.trial162.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 373 kB/s | 48 kB 00:00 2026-02-17T12:17:43.606 INFO:teuthology.orchestra.run.trial162.stdout:(96/98): python3-zc-lockfile-2.0-10.el9.noarch. 197 kB/s | 20 kB 00:00 2026-02-17T12:17:43.607 INFO:teuthology.orchestra.run.trial162.stdout:(97/98): python3-xmltodict-0.12.0-15.el9.noarch 199 kB/s | 22 kB 00:00 2026-02-17T12:18:02.956 INFO:teuthology.orchestra.run.trial162.stdout:(98/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 858 kB/s | 19 MB 00:22 2026-02-17T12:18:02.960 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:02.961 INFO:teuthology.orchestra.run.trial162.stdout:Total 2.9 MB/s | 95 MB 00:33 2026-02-17T12:18:03.367 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:03.405 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:03.405 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:03.822 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:03.822 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:04.258 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:04.260 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-17T12:18:04.291 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-17T12:18:04.297 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-17T12:18:04.319 INFO:teuthology.orchestra.run.trial162.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-17T12:18:04.329 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-17T12:18:04.335 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-17T12:18:04.367 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-17T12:18:04.377 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-17T12:18:04.382 INFO:teuthology.orchestra.run.trial162.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-17T12:18:04.384 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-17T12:18:04.389 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-17T12:18:04.412 INFO:teuthology.orchestra.run.trial162.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-17T12:18:04.424 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-17T12:18:04.427 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-17T12:18:04.433 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-17T12:18:04.435 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-17T12:18:04.446 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T12:18:04.452 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-17T12:18:04.476 INFO:teuthology.orchestra.run.trial162.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-17T12:18:04.479 INFO:teuthology.orchestra.run.trial162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-17T12:18:04.486 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-17T12:18:04.511 INFO:teuthology.orchestra.run.trial162.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-17T12:18:04.562 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-17T12:18:04.574 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-17T12:18:04.577 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-17T12:18:04.581 INFO:teuthology.orchestra.run.trial162.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-17T12:18:04.587 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-17T12:18:04.591 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-17T12:18:04.594 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-17T12:18:04.609 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-17T12:18:04.630 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-17T12:18:04.634 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-17T12:18:04.639 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-17T12:18:04.651 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-17T12:18:04.660 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-17T12:18:04.668 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-17T12:18:04.687 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-17T12:18:04.696 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-17T12:18:04.750 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-17T12:18:04.762 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-17T12:18:04.778 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-17T12:18:04.782 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-17T12:18:04.790 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-17T12:18:04.830 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-17T12:18:05.155 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-17T12:18:05.165 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-17T12:18:05.169 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-17T12:18:05.175 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-17T12:18:05.177 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-17T12:18:05.205 INFO:teuthology.orchestra.run.trial162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-17T12:18:05.249 INFO:teuthology.orchestra.run.trial162.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-17T12:18:05.255 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-17T12:18:05.259 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-17T12:18:05.265 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-17T12:18:05.268 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-17T12:18:05.275 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-17T12:18:05.279 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-17T12:18:05.307 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-17T12:18:05.317 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-17T12:18:05.351 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-17T12:18:05.575 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-17T12:18:05.599 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-17T12:18:05.603 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-17T12:18:05.661 INFO:teuthology.orchestra.run.trial162.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-17T12:18:05.663 INFO:teuthology.orchestra.run.trial162.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-17T12:18:05.684 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-17T12:18:06.009 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-17T12:18:06.082 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-17T12:18:06.753 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-17T12:18:06.771 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-17T12:18:06.785 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-17T12:18:06.800 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-17T12:18:06.876 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-17T12:18:06.885 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-17T12:18:06.908 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-17T12:18:06.938 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-17T12:18:06.989 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-17T12:18:06.995 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-17T12:18:06.998 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-17T12:18:06.999 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-17T12:18:07.017 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:18:07.017 INFO:teuthology.orchestra.run.trial162.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T12:18:07.017 INFO:teuthology.orchestra.run.trial162.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T12:18:07.017 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:07.024 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:18:07.049 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:18:07.049 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T12:18:07.049 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:07.084 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-17T12:18:07.147 INFO:teuthology.orchestra.run.trial162.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-17T12:18:07.150 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 84/98 2026-02-17T12:18:07.164 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 84/98 2026-02-17T12:18:07.164 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:18:07.164 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T12:18:07.164 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:07.877 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 85/98 2026-02-17T12:18:07.902 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 85/98 2026-02-17T12:18:07.902 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:18:07.902 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T12:18:07.902 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:18:07.903 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:18:07.903 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:07.957 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 86/98 2026-02-17T12:18:07.959 INFO:teuthology.orchestra.run.trial162.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 86/98 2026-02-17T12:18:07.964 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 87/98 2026-02-17T12:18:07.983 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 88/98 2026-02-17T12:18:07.984 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 89/98 2026-02-17T12:18:08.479 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 89/98 2026-02-17T12:18:08.482 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 90/98 2026-02-17T12:18:08.942 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 90/98 2026-02-17T12:18:08.943 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 91/98 2026-02-17T12:18:08.955 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 91/98 2026-02-17T12:18:08.955 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 92/98 2026-02-17T12:18:09.010 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 92/98 2026-02-17T12:18:09.060 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 93/98 2026-02-17T12:18:09.061 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 94/98 2026-02-17T12:18:09.083 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 94/98 2026-02-17T12:18:09.083 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:18:09.083 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T12:18:09.084 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:18:09.084 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:18:09.084 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:09.095 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 95/98 2026-02-17T12:18:09.316 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 95/98 2026-02-17T12:18:09.317 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 96/98 2026-02-17T12:18:09.338 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 96/98 2026-02-17T12:18:09.338 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:18:09.338 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T12:18:09.338 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:18:09.338 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:18:09.338 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:09.441 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/98 2026-02-17T12:18:09.461 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/98 2026-02-17T12:18:09.461 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:18:09.462 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T12:18:09.462 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:18:09.462 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:18:09.462 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:09.480 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/98 2026-02-17T12:18:10.167 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/98 2026-02-17T12:18:10.168 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-17T12:18:10.169 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-17T12:18:10.170 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-17T12:18:10.171 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-17T12:18:10.172 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-17T12:18:10.173 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-17T12:18:10.174 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-17T12:18:10.175 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-17T12:18:10.231 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-17T12:18:10.231 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:10.231 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.232 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T12:18:10.233 INFO:teuthology.orchestra.run.trial162.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T12:18:10.234 INFO:teuthology.orchestra.run.trial162.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T12:18:10.235 INFO:teuthology.orchestra.run.trial162.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T12:18:10.236 INFO:teuthology.orchestra.run.trial162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T12:18:10.237 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T12:18:10.238 INFO:teuthology.orchestra.run.trial162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: zip-3.0-35.el9.x86_64 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:10.239 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:10.286 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-base 2026-02-17T12:18:10.600 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:10.664 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:10.682 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:10.682 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:10.682 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:10.704 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install cephadm 2026-02-17T12:18:11.015 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:11.080 INFO:teuthology.orchestra.run.trial162.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:18:11.097 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:11.098 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:11.098 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:11.121 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T12:18:11.431 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:11.512 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:11.512 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:11.513 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 145 k 2026-02-17T12:18:11.514 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 431 k 2026-02-17T12:18:11.514 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:18:11.608 INFO:teuthology.orchestra.run.trial162.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.5 MB/s | 145 kB 00:00 2026-02-17T12:18:11.608 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:11.608 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.5 MB/s | 145 kB 00:00 2026-02-17T12:18:11.608 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:11.611 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:11.612 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:11.643 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:11.644 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:11.701 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:11.702 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:18:11.725 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:18:11.725 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:18:11.725 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T12:18:11.725 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:12.046 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:18:12.046 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:12.046 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:12.047 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:12.047 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:12.047 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:12.074 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr 2026-02-17T12:18:12.380 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:12.444 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:12.461 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:12.462 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:12.462 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:12.483 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T12:18:12.795 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:12.859 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:18:12.877 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:12.878 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:12.878 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:12.899 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T12:18:13.212 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:00 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:13.277 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:18:13.294 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:13.295 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:13.295 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:13.316 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-rook 2026-02-17T12:18:13.624 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:00 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:13.688 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:18:13.705 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:13.706 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:13.706 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:13.727 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T12:18:14.030 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:14.094 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:18:14.112 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:14.112 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:14.112 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:14.134 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-fuse 2026-02-17T12:18:14.450 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:14.532 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:18:14.533 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:14.533 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T12:18:14.533 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:14.533 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.2 M 2026-02-17T12:18:14.533 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 3.6 M 2026-02-17T12:18:14.533 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:18:14.652 INFO:teuthology.orchestra.run.trial162.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T12:18:14.652 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:14.652 INFO:teuthology.orchestra.run.trial162.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T12:18:14.652 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:14.656 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:14.656 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:14.690 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:14.690 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:14.791 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:14.808 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:15.046 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:15.102 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:15.102 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:15.102 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:15.102 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:15.102 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:15.102 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:15.130 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-volume 2026-02-17T12:18:15.442 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:02 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:15.508 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:18:15.526 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:15.526 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:15.526 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:15.548 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados-devel 2026-02-17T12:18:15.858 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:02 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:15.939 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:15.940 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T12:18:15.941 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:15.941 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 127 k 2026-02-17T12:18:15.941 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 456 k 2026-02-17T12:18:15.941 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:18:16.024 INFO:teuthology.orchestra.run.trial162.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.5 MB/s | 127 kB 00:00 2026-02-17T12:18:16.024 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:16.025 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.5 MB/s | 127 kB 00:00 2026-02-17T12:18:16.025 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:16.027 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:16.027 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:16.059 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:16.059 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:16.114 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:16.130 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:16.210 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:16.269 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:16.269 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:16.269 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:16.269 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:16.269 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:16.270 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:16.301 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs2 2026-02-17T12:18:16.616 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:03 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:16.680 INFO:teuthology.orchestra.run.trial162.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:16.698 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:16.699 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:16.699 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:16.720 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs-devel 2026-02-17T12:18:17.029 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:04 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:17.114 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:17.114 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:17.114 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T12:18:17.114 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:17.114 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 34 k 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 153 k 2026-02-17T12:18:17.115 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:18:17.178 INFO:teuthology.orchestra.run.trial162.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 530 kB/s | 34 kB 00:00 2026-02-17T12:18:17.178 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:17.178 INFO:teuthology.orchestra.run.trial162.stdout:Total 524 kB/s | 34 kB 00:00 2026-02-17T12:18:17.178 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:17.180 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:17.180 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:17.182 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:17.182 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:17.205 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:17.221 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:17.280 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:17.337 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:17.337 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:17.337 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:17.337 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:17.337 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:17.337 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:17.363 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados2 2026-02-17T12:18:17.676 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:04 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:17.740 INFO:teuthology.orchestra.run.trial162.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:17.758 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:17.758 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:17.758 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:17.780 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librbd1 2026-02-17T12:18:18.095 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:05 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:18.159 INFO:teuthology.orchestra.run.trial162.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:18.177 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:18.177 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:18.177 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:18.200 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rados 2026-02-17T12:18:18.512 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:05 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:18.577 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:18.594 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:18.594 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:18.594 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:18.617 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rgw 2026-02-17T12:18:18.926 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:05 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:18.990 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:19.008 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:19.008 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:19.008 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:19.030 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-cephfs 2026-02-17T12:18:19.338 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:06 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:19.401 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:19.418 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:19.419 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:19.419 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:19.441 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rbd 2026-02-17T12:18:19.752 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:06 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:19.817 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:18:19.835 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:19.836 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-17T12:18:19.836 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:19.857 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-fuse 2026-02-17T12:18:20.166 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:07 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:20.251 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:18:20.252 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:20.252 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T12:18:20.252 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:20.252 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 85 k 2026-02-17T12:18:20.252 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 227 k 2026-02-17T12:18:20.252 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:18:20.325 INFO:teuthology.orchestra.run.trial162.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T12:18:20.326 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:20.326 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T12:18:20.326 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:20.329 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:20.330 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:20.360 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:20.361 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:20.414 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:20.431 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:20.510 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:20.567 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:20.567 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:20.567 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:20.567 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:20.567 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:20.567 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:20.593 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-mirror 2026-02-17T12:18:20.910 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:07 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:20.992 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:20.993 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 3.1 M 2026-02-17T12:18:20.994 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 13 M 2026-02-17T12:18:20.994 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:18:21.142 INFO:teuthology.orchestra.run.trial162.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T12:18:21.143 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:21.143 INFO:teuthology.orchestra.run.trial162.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T12:18:21.143 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:21.147 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:21.147 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:21.188 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:21.189 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:21.390 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:21.392 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:21.414 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:21.414 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:18:21.414 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T12:18:21.414 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:18:21.415 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:18:21.415 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:21.720 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:21.721 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:21.721 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:21.721 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:21.721 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:21.721 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:21.750 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-nbd 2026-02-17T12:18:22.073 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:09 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:18:22.155 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-17T12:18:22.155 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 171 k 2026-02-17T12:18:22.156 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 490 k 2026-02-17T12:18:22.157 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-17T12:18:22.240 INFO:teuthology.orchestra.run.trial162.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T12:18:22.240 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:22.240 INFO:teuthology.orchestra.run.trial162.stdout:Total 2.0 MB/s | 171 kB 00:00 2026-02-17T12:18:22.240 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-17T12:18:22.244 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-17T12:18:22.244 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-17T12:18:22.276 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-17T12:18:22.276 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-17T12:18:22.331 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-17T12:18:22.348 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:22.426 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:22.484 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:18:22.484 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:22.484 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-17T12:18:22.484 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:18:22.484 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:22.484 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-17T12:18:22.515 DEBUG:teuthology.parallel:result is None 2026-02-17T12:18:22.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:18:22.672 DEBUG:teuthology.orchestra.run.trial162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T12:18:22.693 INFO:teuthology.orchestra.run.trial162.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T12:18:22.694 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T12:18:22.694 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T12:18:22.696 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T12:18:22.696 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:22.696 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T12:18:22.758 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T12:18:22.759 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:22.759 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T12:18:22.828 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T12:18:22.898 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T12:18:22.899 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:22.899 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T12:18:22.964 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T12:18:23.027 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T12:18:23.027 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:23.027 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T12:18:23.091 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T12:18:23.155 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-17T12:18:23.284 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'CEPHADM_FAILED_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T12:18:23.284 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:18:23.288 INFO:tasks.cephadm:Cluster fsid is c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:23.288 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-17T12:18:23.288 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.162'} 2026-02-17T12:18:23.288 INFO:tasks.cephadm:First mon is mon.a on trial162 2026-02-17T12:18:23.288 INFO:tasks.cephadm:First mgr is a 2026-02-17T12:18:23.288 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-17T12:18:23.288 DEBUG:teuthology.orchestra.run.trial162:> sudo hostname $(hostname -s) 2026-02-17T12:18:23.313 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-17T12:18:23.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:18:23.443 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/', 'ref': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-13 11:49:02.520668', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-675-g3c96dfb3', 'package_manager_version': '19.2.3-675.g3c96dfb3', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2967/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-17T12:18:23.591 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-bharath20-testing-2026-02-13-0906-squid, sha1 3c96dfb3f50b3d02598a82af7104764bfdcd3919 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:18:23.592 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/x86_64/flavors/default/cephadm 2026-02-17T12:18:23.592 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/x86_64/flavors/default/cephadm 2026-02-17T12:18:23.592 DEBUG:teuthology.orchestra.run.trial162:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T12:18:23.850 INFO:teuthology.orchestra.run.trial162.stdout:-rw-r--r--. 1 ubuntu ubuntu 788277 Feb 17 12:18 /home/ubuntu/cephtest/cephadm 2026-02-17T12:18:23.851 DEBUG:teuthology.orchestra.run.trial162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T12:18:23.884 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 on all hosts... 2026-02-17T12:18:23.884 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 pull 2026-02-17T12:18:24.083 INFO:teuthology.orchestra.run.trial162.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919... 2026-02-17T12:18:33.048 INFO:teuthology.orchestra.run.trial162.stdout:{ 2026-02-17T12:18:33.048 INFO:teuthology.orchestra.run.trial162.stdout: "ceph_version": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:18:33.048 INFO:teuthology.orchestra.run.trial162.stdout: "image_id": "61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73", 2026-02-17T12:18:33.048 INFO:teuthology.orchestra.run.trial162.stdout: "repo_digests": [ 2026-02-17T12:18:33.048 INFO:teuthology.orchestra.run.trial162.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6" 2026-02-17T12:18:33.048 INFO:teuthology.orchestra.run.trial162.stdout: ] 2026-02-17T12:18:33.048 INFO:teuthology.orchestra.run.trial162.stdout:} 2026-02-17T12:18:33.065 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /etc/ceph 2026-02-17T12:18:33.125 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod 777 /etc/ceph 2026-02-17T12:18:33.150 INFO:tasks.cephadm:Writing seed config... 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-17T12:18:33.152 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-17T12:18:33.153 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:33.154 DEBUG:teuthology.orchestra.run.trial162:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T12:18:33.206 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c0fec2e3-0bfa-11f1-8517-d404e6e7d460 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-17T12:18:33.206 DEBUG:teuthology.orchestra.run.trial162:mon.a> sudo journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service 2026-02-17T12:18:33.248 DEBUG:teuthology.orchestra.run.trial162:mgr.a> sudo journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a.service 2026-02-17T12:18:33.290 INFO:tasks.cephadm:Bootstrapping... 2026-02-17T12:18:33.290 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 -v bootstrap --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.162 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:18:33.427 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:18:33.428 INFO:teuthology.orchestra.run.trial162.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919', '-v', 'bootstrap', '--fsid', 'c0fec2e3-0bfa-11f1-8517-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.162', '--skip-admin-label'] 2026-02-17T12:18:33.428 INFO:teuthology.orchestra.run.trial162.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-17T12:18:33.428 INFO:teuthology.orchestra.run.trial162.stdout:Verifying podman|docker is present... 2026-02-17T12:18:33.442 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stdout 5.6.0 2026-02-17T12:18:33.443 INFO:teuthology.orchestra.run.trial162.stdout:Verifying lvm2 is present... 2026-02-17T12:18:33.443 INFO:teuthology.orchestra.run.trial162.stdout:Verifying time synchronization is in place... 2026-02-17T12:18:33.448 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T12:18:33.449 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T12:18:33.454 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T12:18:33.454 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout inactive 2026-02-17T12:18:33.460 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout enabled 2026-02-17T12:18:33.466 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout active 2026-02-17T12:18:33.466 INFO:teuthology.orchestra.run.trial162.stdout:Unit chronyd.service is enabled and running 2026-02-17T12:18:33.466 INFO:teuthology.orchestra.run.trial162.stdout:Repeating the final host check... 2026-02-17T12:18:33.482 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stdout 5.6.0 2026-02-17T12:18:33.482 INFO:teuthology.orchestra.run.trial162.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-17T12:18:33.482 INFO:teuthology.orchestra.run.trial162.stdout:systemctl is present 2026-02-17T12:18:33.482 INFO:teuthology.orchestra.run.trial162.stdout:lvcreate is present 2026-02-17T12:18:33.487 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T12:18:33.487 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T12:18:33.493 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T12:18:33.493 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout inactive 2026-02-17T12:18:33.498 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout enabled 2026-02-17T12:18:33.505 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout active 2026-02-17T12:18:33.505 INFO:teuthology.orchestra.run.trial162.stdout:Unit chronyd.service is enabled and running 2026-02-17T12:18:33.505 INFO:teuthology.orchestra.run.trial162.stdout:Host looks OK 2026-02-17T12:18:33.505 INFO:teuthology.orchestra.run.trial162.stdout:Cluster fsid: c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:33.505 INFO:teuthology.orchestra.run.trial162.stdout:Acquiring lock 139685896146704 on /run/cephadm/c0fec2e3-0bfa-11f1-8517-d404e6e7d460.lock 2026-02-17T12:18:33.505 INFO:teuthology.orchestra.run.trial162.stdout:Lock 139685896146704 acquired on /run/cephadm/c0fec2e3-0bfa-11f1-8517-d404e6e7d460.lock 2026-02-17T12:18:33.505 INFO:teuthology.orchestra.run.trial162.stdout:Verifying IP 10.20.193.162 port 3300 ... 2026-02-17T12:18:33.506 INFO:teuthology.orchestra.run.trial162.stdout:Verifying IP 10.20.193.162 port 6789 ... 2026-02-17T12:18:33.506 INFO:teuthology.orchestra.run.trial162.stdout:Base mon IP(s) is [10.20.193.162:3300, 10.20.193.162:6789], mon addrv is [v2:10.20.193.162:3300,v1:10.20.193.162:6789] 2026-02-17T12:18:33.509 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.162 metric 102 2026-02-17T12:18:33.509 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.162 metric 102 2026-02-17T12:18:33.509 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T12:18:33.511 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-17T12:18:33.511 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-17T12:18:33.512 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout inet6 fe80::cc06:d022:9046:6ad4/64 scope link noprefixroute 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:621c/64 scope link 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T12:18:33.515 INFO:teuthology.orchestra.run.trial162.stdout:Mon IP `10.20.193.162` is in CIDR network `10.20.192.0/20` 2026-02-17T12:18:33.516 INFO:teuthology.orchestra.run.trial162.stdout:Mon IP `10.20.193.162` is in CIDR network `10.20.192.0/20` 2026-02-17T12:18:33.516 INFO:teuthology.orchestra.run.trial162.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-17T12:18:33.516 INFO:teuthology.orchestra.run.trial162.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-17T12:18:33.516 INFO:teuthology.orchestra.run.trial162.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919... 2026-02-17T12:18:33.788 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stdout 61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 2026-02-17T12:18:33.788 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919... 2026-02-17T12:18:33.789 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stderr Getting image source signatures 2026-02-17T12:18:33.789 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stderr Copying blob sha256:4530141b72ed2035566112fee61d7f6ef5d3adf36618f0dfd3cb86a1e0741855 2026-02-17T12:18:33.789 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stderr Copying blob sha256:f288f3bfe1f1dd15cb8f17590a708af9d9397de617368b4f9c06e9bc583d4a6b 2026-02-17T12:18:33.789 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stderr Copying config sha256:61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 2026-02-17T12:18:33.789 INFO:teuthology.orchestra.run.trial162.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-17T12:18:34.049 INFO:teuthology.orchestra.run.trial162.stdout:ceph: stdout ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable) 2026-02-17T12:18:34.050 INFO:teuthology.orchestra.run.trial162.stdout:Ceph version: ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable) 2026-02-17T12:18:34.050 INFO:teuthology.orchestra.run.trial162.stdout:Extracting ceph user uid/gid from container image... 2026-02-17T12:18:34.302 INFO:teuthology.orchestra.run.trial162.stdout:stat: stdout 167 167 2026-02-17T12:18:34.302 INFO:teuthology.orchestra.run.trial162.stdout:Creating initial keys... 2026-02-17T12:18:34.555 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph-authtool: stdout AQCaXJRpV8g7GhAA9pk2iLsXJw7jyhwEteGblw== 2026-02-17T12:18:34.815 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph-authtool: stdout AQCaXJRp+hq2KRAAo0RcKGqdnrZ159AFQCrkIA== 2026-02-17T12:18:35.074 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph-authtool: stdout AQCaXJRpaV0pORAAQmh8/MyIpva6SWU2is40tA== 2026-02-17T12:18:35.075 INFO:teuthology.orchestra.run.trial162.stdout:Creating initial monmap... 2026-02-17T12:18:35.364 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T12:18:35.364 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-17T12:18:35.364 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:35.364 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T12:18:35.364 INFO:teuthology.orchestra.run.trial162.stdout:monmaptool for a [v2:10.20.193.162:3300,v1:10.20.193.162:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T12:18:35.364 INFO:teuthology.orchestra.run.trial162.stdout:setting min_mon_release = quincy 2026-02-17T12:18:35.365 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/monmaptool: set fsid to c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:35.365 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T12:18:35.365 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:35.365 INFO:teuthology.orchestra.run.trial162.stdout:Creating mon... 2026-02-17T12:18:35.630 INFO:teuthology.orchestra.run.trial162.stdout:create mon.a on 2026-02-17T12:18:35.797 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-17T12:18:35.903 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-17T12:18:36.012 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460.target → /etc/systemd/system/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460.target. 2026-02-17T12:18:36.012 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460.target → /etc/systemd/system/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460.target. 2026-02-17T12:18:36.134 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a 2026-02-17T12:18:36.134 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service: Unit ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service not loaded. 2026-02-17T12:18:36.259 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460.target.wants/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@.service. 2026-02-17T12:18:36.406 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:18:36.406 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout disabled 2026-02-17T12:18:36.413 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:18:36.413 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout inactive 2026-02-17T12:18:36.413 INFO:teuthology.orchestra.run.trial162.stdout:firewalld.service is not enabled 2026-02-17T12:18:36.413 INFO:teuthology.orchestra.run.trial162.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T12:18:36.413 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for mon to start... 2026-02-17T12:18:36.413 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for mon... 2026-02-17T12:18:36.716 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout cluster: 2026-02-17T12:18:36.716 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout id: c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout services: 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.175237s) 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout data: 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-17T12:18:36.717 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-17T12:18:36.718 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout pgs: 2026-02-17T12:18:36.718 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:36.718 INFO:teuthology.orchestra.run.trial162.stdout:mon is available 2026-02-17T12:18:36.718 INFO:teuthology.orchestra.run.trial162.stdout:Assimilating anything we can from ceph.conf... 2026-02-17T12:18:36.992 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:36.992 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T12:18:36.992 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout fsid = c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:36.992 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T12:18:36.992 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.162:3300,v1:10.20.193.162:6789] 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T12:18:36.993 INFO:teuthology.orchestra.run.trial162.stdout:Generating new minimal ceph.conf... 2026-02-17T12:18:37.265 INFO:teuthology.orchestra.run.trial162.stdout:Restarting the monitor... 2026-02-17T12:18:37.574 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a[38992]: 2026-02-17T12:18:37.341+0000 7f435939d640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T12:18:37.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 podman[39397]: 2026-02-17 12:18:37.574676532 +0000 UTC m=+0.246946766 container died f9622125798e83aef25e604fba5cb8cd7da359531b9fbd41358af5180695ca9f (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a, ceph=True, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-17T12:18:37.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 podman[39397]: 2026-02-17 12:18:37.684984579 +0000 UTC m=+0.357254793 container remove f9622125798e83aef25e604fba5cb8cd7da359531b9fbd41358af5180695ca9f (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default) 2026-02-17T12:18:37.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 bash[39397]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a 2026-02-17T12:18:37.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-17T12:18:37.838 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 systemd[1]: Stopped Ceph mon.a for c0fec2e3-0bfa-11f1-8517-d404e6e7d460. 2026-02-17T12:18:37.838 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 systemd[1]: Starting Ceph mon.a for c0fec2e3-0bfa-11f1-8517-d404e6e7d460... 2026-02-17T12:18:37.875 INFO:teuthology.orchestra.run.trial162.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-17T12:18:38.154 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 podman[39538]: 2026-02-17 12:18:37.836988239 +0000 UTC m=+0.015588449 container create 5ee8407c25a260674b94c2b954087f9e241f72c9e9357a869cfcd08da48c823b (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260209, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, ceph=True) 2026-02-17T12:18:38.154 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 podman[39538]: 2026-02-17 12:18:37.86772707 +0000 UTC m=+0.046327260 container init 5ee8407c25a260674b94c2b954087f9e241f72c9e9357a869cfcd08da48c823b (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, ceph=True, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.build-date=20260209, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T12:18:38.154 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 podman[39538]: 2026-02-17 12:18:37.871002948 +0000 UTC m=+0.049603148 container start 5ee8407c25a260674b94c2b954087f9e241f72c9e9357a869cfcd08da48c823b (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2) 2026-02-17T12:18:38.154 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 bash[39538]: 5ee8407c25a260674b94c2b954087f9e241f72c9e9357a869cfcd08da48c823b 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 podman[39538]: 2026-02-17 12:18:37.830528004 +0000 UTC m=+0.009128194 image pull 61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 systemd[1]: Started Ceph mon.a for c0fec2e3-0bfa-11f1-8517-d404e6e7d460. 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: set uid:gid to 167:167 (ceph:ceph) 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable), process ceph-mon, pid 7 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: pidfile_write: ignore empty --pid-file 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: load: jerasure load: lrc 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: RocksDB version: 7.9.2 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Git sha 0 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Compile date 2026-02-13 11:06:07 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: DB SUMMARY 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: DB Session ID: SSLV8X0HHY1NCNDRSY3L 2026-02-17T12:18:38.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: CURRENT file: CURRENT 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: IDENTITY file: IDENTITY 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 74989 ; 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.error_if_exists: 0 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.create_if_missing: 0 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.paranoid_checks: 1 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.env: 0x55e41c3b6dc0 2026-02-17T12:18:38.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.fs: PosixFileSystem 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.info_log: 0x55e41e3f9900 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_file_opening_threads: 16 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.statistics: (nil) 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.use_fsync: 0 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_log_file_size: 0 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.keep_log_file_num: 1000 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.recycle_log_file_num: 0 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.allow_fallocate: 1 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.allow_mmap_reads: 0 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.allow_mmap_writes: 0 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.use_direct_reads: 0 2026-02-17T12:18:38.157 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.create_missing_column_families: 0 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.db_log_dir: 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.wal_dir: 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.advise_random_on_open: 1 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.db_write_buffer_size: 0 2026-02-17T12:18:38.158 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.write_buffer_manager: 0x55e41e3fd900 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.rate_limiter: (nil) 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.wal_recovery_mode: 2 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.enable_thread_tracking: 0 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.enable_pipelined_write: 0 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.unordered_write: 0 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-17T12:18:38.159 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.row_cache: None 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.wal_filter: None 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.allow_ingest_behind: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.two_write_queues: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.manual_wal_flush: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.wal_compression: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.atomic_flush: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-17T12:18:38.160 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.log_readahead_size: 0 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.best_efforts_recovery: 0 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.allow_data_in_errors: 0 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.db_host_id: __hostname__ 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_background_jobs: 2 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_background_compactions: -1 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_subcompactions: 1 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-17T12:18:38.161 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_total_wal_size: 0 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_open_files: -1 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bytes_per_sync: 0 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_readahead_size: 0 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_background_flushes: -1 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Compression algorithms supported: 2026-02-17T12:18:38.162 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kZSTD supported: 0 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kXpressCompression supported: 0 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kBZip2Compression supported: 0 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kLZ4Compression supported: 1 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kZlibCompression supported: 1 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kLZ4HCCompression supported: 1 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: kSnappyCompression supported: 1 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-17T12:18:38.163 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.merge_operator: 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_filter: None 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_filter_factory: None 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.sst_partitioner_factory: None 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e41e3f85c0) 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout: cache_index_and_filter_blocks: 1 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout: pin_top_level_index_and_filter: 1 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout: index_type: 0 2026-02-17T12:18:38.164 INFO:journalctl@ceph.mon.a.trial162.stdout: data_block_index_type: 0 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: index_shortening: 1 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: checksum: 4 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: no_block_cache: 0 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: block_cache: 0x55e41e41d350 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: block_cache_name: BinnedLRUCache 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: block_cache_options: 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: capacity : 536870912 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: num_shard_bits : 4 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: strict_capacity_limit : 0 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: high_pri_pool_ratio: 0.000 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: block_cache_compressed: (nil) 2026-02-17T12:18:38.165 INFO:journalctl@ceph.mon.a.trial162.stdout: persistent_cache: (nil) 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: block_size: 4096 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: block_size_deviation: 10 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: block_restart_interval: 16 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: index_block_restart_interval: 1 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: metadata_block_size: 4096 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: partition_filters: 0 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: use_delta_encoding: 1 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: filter_policy: bloomfilter 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: whole_key_filtering: 1 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: verify_compression: 0 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: read_amp_bytes_per_bit: 0 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: format_version: 5 2026-02-17T12:18:38.166 INFO:journalctl@ceph.mon.a.trial162.stdout: enable_index_compression: 1 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout: block_align: 0 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout: max_auto_readahead_size: 262144 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout: prepopulate_block_cache: 0 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout: initial_auto_readahead_size: 8192 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout: num_file_reads_for_auto_readahead: 2 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.write_buffer_size: 33554432 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_write_buffer_number: 2 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression: NoCompression 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression: Disabled 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.prefix_extractor: nullptr 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-17T12:18:38.167 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.num_levels: 7 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-17T12:18:38.168 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.level: 32767 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.strategy: 0 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.enabled: false 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.target_file_size_base: 67108864 2026-02-17T12:18:38.169 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-17T12:18:38.170 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.arena_block_size: 1048576 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.disable_auto_compactions: 0 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-17T12:18:38.171 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.inplace_update_support: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.bloom_locality: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.max_successive_merges: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.paranoid_file_checks: 0 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.force_consistency_checks: 1 2026-02-17T12:18:38.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.report_bg_io_stats: 0 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.ttl: 2592000 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.enable_blob_files: false 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.min_blob_size: 0 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.blob_file_size: 268435456 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-17T12:18:38.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.blob_file_starting_level: 0 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4277c2cd-69cc-43c1-a110-25e06ce3f115 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771330717889206, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771330717890199, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 72130, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 223, "table_properties": {"data_size": 70401, "index_size": 178, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9550, "raw_average_key_size": 49, "raw_value_size": 64973, "raw_average_value_size": 334, "num_data_blocks": 8, "num_entries": 194, "num_filter_entries": 194, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771330717, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4277c2cd-69cc-43c1-a110-25e06ce3f115", "db_session_id": "SSLV8X0HHY1NCNDRSY3L", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771330717890257, "job": 1, "event": "recovery_finished"} 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e41e41ee00 2026-02-17T12:18:38.174 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: DB pointer 0x55e41e52a000 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: ** DB Stats ** 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: 2026-02-17T12:18:38.175 INFO:journalctl@ceph.mon.a.trial162.stdout: ** Compaction Stats [default] ** 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: L0 2/0 72.30 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 92.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: Sum 2/0 72.30 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 92.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 92.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: ** Compaction Stats [default] ** 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 92.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: 2026-02-17T12:18:38.176 INFO:journalctl@ceph.mon.a.trial162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: Cumulative compaction: 0.00 GB write, 23.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: Interval compaction: 0.00 GB write, 23.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: Block cache BinnedLRUCache@0x55e41e41d350#7 capacity: 512.00 MB usage: 1.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.70 KB,0.00013411%) IndexBlock(2,0.38 KB,7.15256e-05%) Misc(1,0.00 KB,0%) 2026-02-17T12:18:38.177 INFO:journalctl@ceph.mon.a.trial162.stdout: 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: starting mon.a rank 0 at public addrs [v2:10.20.193.162:3300/0,v1:10.20.193.162:6789/0] at bind addrs [v2:10.20.193.162:3300/0,v1:10.20.193.162:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???) e1 preinit fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???).mds e1 new map 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???).mds e1 print_map 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: e1 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: btime 2026-02-17T12:18:36:418188+0000 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: legacy client fscid: -1 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: 2026-02-17T12:18:38.178 INFO:journalctl@ceph.mon.a.trial162.stdout: No filesystems configured 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: monmap epoch 1 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: last_changed 2026-02-17T12:18:35.232742+0000 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: created 2026-02-17T12:18:35.232742+0000 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: min_mon_release 19 (squid) 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: election_strategy: 1 2026-02-17T12:18:38.179 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: 0: [v2:10.20.193.162:3300/0,v1:10.20.193.162:6789/0] mon.a 2026-02-17T12:18:38.180 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: fsmap 2026-02-17T12:18:38.180 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: osdmap e1: 0 total, 0 up, 0 in 2026-02-17T12:18:38.180 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:37 trial162 ceph-mon[39588]: mgrmap e1: no daemons active 2026-02-17T12:18:38.181 INFO:teuthology.orchestra.run.trial162.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-17T12:18:38.181 INFO:teuthology.orchestra.run.trial162.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:18:38.181 INFO:teuthology.orchestra.run.trial162.stdout:Creating mgr... 2026-02-17T12:18:38.181 INFO:teuthology.orchestra.run.trial162.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-17T12:18:38.181 INFO:teuthology.orchestra.run.trial162.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-17T12:18:38.286 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a 2026-02-17T12:18:38.286 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a.service: Unit ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a.service not loaded. 2026-02-17T12:18:38.401 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460.target.wants/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@.service. 2026-02-17T12:18:38.556 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:18:38.556 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout disabled 2026-02-17T12:18:38.561 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:18:38.562 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout inactive 2026-02-17T12:18:38.562 INFO:teuthology.orchestra.run.trial162.stdout:firewalld.service is not enabled 2026-02-17T12:18:38.562 INFO:teuthology.orchestra.run.trial162.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T12:18:38.569 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:18:38.569 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout disabled 2026-02-17T12:18:38.574 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:18:38.574 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout inactive 2026-02-17T12:18:38.575 INFO:teuthology.orchestra.run.trial162.stdout:firewalld.service is not enabled 2026-02-17T12:18:38.575 INFO:teuthology.orchestra.run.trial162.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-17T12:18:38.575 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for mgr to start... 2026-02-17T12:18:38.575 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for mgr... 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "fsid": "c0fec2e3-0bfa-11f1-8517-d404e6e7d460", 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:38.858 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 0 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T12:18:38.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T12:18:38.860 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T12:18:36:418188+0000", 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T12:18:38.861 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T12:18:36.418667+0000", 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:18:38.862 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:38.863 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T12:18:38.863 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:18:38.863 INFO:teuthology.orchestra.run.trial162.stdout:mgr not available, waiting (1/15)... 2026-02-17T12:18:39.192 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3687410878' entity='client.admin' 2026-02-17T12:18:39.192 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/702134705' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T12:18:39.193 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.191+0000 7f2fb5dd7140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:18:39.463 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.225+0000 7f2fb5dd7140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:18:39.464 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.291+0000 7f2fb5dd7140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:18:39.464 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:18:39.464 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:18:39.464 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: from numpy import show_config as show_numpy_config 2026-02-17T12:18:39.464 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.364+0000 7f2fb5dd7140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:18:39.464 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.397+0000 7f2fb5dd7140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:18:39.923 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.493+0000 7f2fb5dd7140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:18:39.923 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.552+0000 7f2fb5dd7140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:18:39.923 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.586+0000 7f2fb5dd7140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:18:39.923 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.618+0000 7f2fb5dd7140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:18:39.923 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.653+0000 7f2fb5dd7140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:18:39.923 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.683+0000 7f2fb5dd7140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:18:39.923 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:39.922+0000 7f2fb5dd7140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:18:40.177 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.021+0000 7f2fb5dd7140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:18:40.177 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.052+0000 7f2fb5dd7140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:18:40.177 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.083+0000 7f2fb5dd7140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:18:40.177 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.175+0000 7f2fb5dd7140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:18:40.463 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.204+0000 7f2fb5dd7140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:18:40.464 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.296+0000 7f2fb5dd7140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:18:41.005 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.754+0000 7f2fb5dd7140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:18:41.005 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:40 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:40.784+0000 7f2fb5dd7140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "fsid": "c0fec2e3-0bfa-11f1-8517-d404e6e7d460", 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:41.129 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 0 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T12:18:41.130 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T12:18:36:418188+0000", 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T12:18:41.131 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T12:18:36.418667+0000", 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:18:41.132 INFO:teuthology.orchestra.run.trial162.stdout:mgr not available, waiting (2/15)... 2026-02-17T12:18:41.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:41 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1843625035' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T12:18:41.463 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:41 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:41.194+0000 7f2fb5dd7140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:18:42.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: Activating manager daemon a 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: mgrmap e2: a(active, starting, since 0.00244226s) 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: Manager daemon a is now available 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' 2026-02-17T12:18:42.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' 2026-02-17T12:18:42.465 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:42 trial162 ceph-mon[39588]: from='mgr.14100 10.20.193.162:0/540968257' entity='mgr.a' 2026-02-17T12:18:43.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:43 trial162 ceph-mon[39588]: mgrmap e3: a(active, since 1.00429s) 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "fsid": "c0fec2e3-0bfa-11f1-8517-d404e6e7d460", 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T12:18:43.500 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 0 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T12:18:43.501 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T12:18:43.502 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T12:18:43.503 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T12:18:36:418188+0000", 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T12:18:43.504 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:43.505 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T12:18:43.506 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:18:43.506 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T12:18:36.418667+0000", 2026-02-17T12:18:43.506 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:18:43.506 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:18:43.506 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T12:18:43.506 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:18:43.506 INFO:teuthology.orchestra.run.trial162.stdout:mgr is available 2026-02-17T12:18:43.834 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:43.834 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T12:18:43.834 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout fsid = c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:43.834 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T12:18:43.834 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.162:3300,v1:10.20.193.162:6789] 2026-02-17T12:18:43.834 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T12:18:43.835 INFO:teuthology.orchestra.run.trial162.stdout:Enabling cephadm module... 2026-02-17T12:18:44.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:44 trial162 ceph-mon[39588]: mgrmap e4: a(active, since 2s) 2026-02-17T12:18:44.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:44 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2904674527' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T12:18:44.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:44 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4105322017' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-17T12:18:44.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:44 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4105322017' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-17T12:18:44.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:44 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2349575691' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-17T12:18:45.067 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:44 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: ignoring --setuser ceph since I am not root 2026-02-17T12:18:45.067 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:44 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: ignoring --setgroup ceph since I am not root 2026-02-17T12:18:45.190 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:18:45.191 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-17T12:18:45.191 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T12:18:45.191 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T12:18:45.191 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T12:18:45.191 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:18:45.191 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for the mgr to restart... 2026-02-17T12:18:45.191 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for mgr epoch 5... 2026-02-17T12:18:45.345 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.120+0000 7f3bbe856140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:18:45.346 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.267+0000 7f3bbe856140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:18:45.346 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.302+0000 7f3bbe856140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:18:45.346 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.344+0000 7f3bbe856140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.375+0000 7f3bbe856140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.409+0000 7f3bbe856140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.474+0000 7f3bbe856140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: from numpy import show_config as show_numpy_config 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.546+0000 7f3bbe856140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:18:45.678 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.580+0000 7f3bbe856140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:18:45.679 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.676+0000 7f3bbe856140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:18:45.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2349575691' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-17T12:18:45.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-mon[39588]: mgrmap e5: a(active, since 3s) 2026-02-17T12:18:45.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1675248621' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T12:18:45.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.736+0000 7f3bbe856140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:18:45.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.770+0000 7f3bbe856140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:18:45.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.802+0000 7f3bbe856140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:18:45.965 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.836+0000 7f3bbe856140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:18:45.965 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:45 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:45.866+0000 7f3bbe856140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:18:46.355 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.099+0000 7f3bbe856140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:18:46.355 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.199+0000 7f3bbe856140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:18:46.355 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.229+0000 7f3bbe856140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:18:46.355 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.260+0000 7f3bbe856140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:18:46.356 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.353+0000 7f3bbe856140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:18:46.713 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.382+0000 7f3bbe856140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:18:46.713 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.474+0000 7f3bbe856140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:18:47.213 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.934+0000 7f3bbe856140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:18:47.213 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:46 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:46.964+0000 7f3bbe856140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:18:47.713 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:47.358+0000 7f3bbe856140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: Active manager daemon a restarted 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: Activating manager daemon a 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: osdmap e2: 0 total, 0 up, 0 in 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: mgrmap e6: a(active, starting, since 0.00246816s) 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T12:18:47.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: Manager daemon a is now available 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T12:18:47.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:47 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T12:18:48.492 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:18:48.492 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-17T12:18:48.492 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T12:18:48.492 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:18:48.492 INFO:teuthology.orchestra.run.trial162.stdout:mgr epoch 5 is available 2026-02-17T12:18:48.492 INFO:teuthology.orchestra.run.trial162.stdout:Setting orchestrator backend to cephadm... 2026-02-17T12:18:48.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:48 trial162 ceph-mon[39588]: Found migration_current of "None". Setting to last migration. 2026-02-17T12:18:48.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:48 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:48.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:48 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:48.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:48 trial162 ceph-mon[39588]: mgrmap e7: a(active, since 1.00391s) 2026-02-17T12:18:48.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:48 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:18:49.182 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-17T12:18:49.183 INFO:teuthology.orchestra.run.trial162.stdout:Generating ssh key... 2026-02-17T12:18:49.524 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: Generating public/private ed25519 key pair. 2026-02-17T12:18:49.524 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: Your identification has been saved in /tmp/tmpst1gvlh8/key 2026-02-17T12:18:49.524 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: Your public key has been saved in /tmp/tmpst1gvlh8/key.pub 2026-02-17T12:18:49.524 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: The key fingerprint is: 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: SHA256:hbxxLHiJiog1QGKRUAewQE9sFd9G8kEhbWWef73LcLA ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: The key's randomart image is: 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: +--[ED25519 256]--+ 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: |XB*ooo.oo=oo | 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: |++o+ .+**+ . | 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: |. +. o.O++o | 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: |.o o . ..* . .| 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: |o . . S o ..| 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: | + .| 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: | E o | 2026-02-17T12:18:49.525 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: | + .| 2026-02-17T12:18:49.526 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: | o | 2026-02-17T12:18:49.526 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: +----[SHA256]-----+ 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:48] ENGINE Bus STARTING 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:48] ENGINE Serving on https://10.20.193.162:7150 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:48] ENGINE Client ('10.20.193.162', 50372) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:48] ENGINE Serving on http://10.20.193.162:8765 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:48] ENGINE Bus STARTED 2026-02-17T12:18:49.854 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:49.855 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:49.855 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:18:49.855 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:49.855 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:49 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:49.859 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJvobM6eBiXqYVg31SddDjcd1nvayiFGoakx4eddFhLy ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:49.859 INFO:teuthology.orchestra.run.trial162.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-17T12:18:49.860 INFO:teuthology.orchestra.run.trial162.stdout:Adding key to root@localhost authorized_keys... 2026-02-17T12:18:49.860 INFO:teuthology.orchestra.run.trial162.stdout:Adding host trial162... 2026-02-17T12:18:50.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:50 trial162 ceph-mon[39588]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:50.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:50 trial162 ceph-mon[39588]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:50.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:50 trial162 ceph-mon[39588]: Generating ssh key... 2026-02-17T12:18:50.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:50 trial162 ceph-mon[39588]: mgrmap e8: a(active, since 2s) 2026-02-17T12:18:50.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:50 trial162 ceph-mon[39588]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:51.625 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout Added host 'trial162' with addr '10.20.193.162' 2026-02-17T12:18:51.625 INFO:teuthology.orchestra.run.trial162.stdout:Deploying unmanaged mon service... 2026-02-17T12:18:51.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:51 trial162 ceph-mon[39588]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial162", "addr": "10.20.193.162", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:51.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:51 trial162 ceph-mon[39588]: Deploying cephadm binary to trial162 2026-02-17T12:18:51.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:51 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:51.837 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:51 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:18:51.959 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-17T12:18:51.960 INFO:teuthology.orchestra.run.trial162.stdout:Deploying unmanaged mgr service... 2026-02-17T12:18:52.303 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-17T12:18:52.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:52 trial162 ceph-mon[39588]: Added host trial162 2026-02-17T12:18:52.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:52 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:52.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:52 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:52.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:52 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:52.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:52 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:52.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:52 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2724645515' entity='client.admin' 2026-02-17T12:18:52.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:52 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:52.982 INFO:teuthology.orchestra.run.trial162.stdout:Enabling the dashboard module... 2026-02-17T12:18:54.049 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:53 trial162 ceph-mon[39588]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:54.050 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:53 trial162 ceph-mon[39588]: Saving service mon spec with placement count:5 2026-02-17T12:18:54.050 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:53 trial162 ceph-mon[39588]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:54.050 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:53 trial162 ceph-mon[39588]: Saving service mgr spec with placement count:2 2026-02-17T12:18:54.050 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:53 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/770856431' entity='client.admin' 2026-02-17T12:18:54.050 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:53 trial162 ceph-mon[39588]: from='mgr.14118 10.20.193.162:0/3188514224' entity='mgr.a' 2026-02-17T12:18:54.050 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:53 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/300079275' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-17T12:18:54.399 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: ignoring --setuser ceph since I am not root 2026-02-17T12:18:54.400 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: ignoring --setgroup ceph since I am not root 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for the mgr to restart... 2026-02-17T12:18:54.524 INFO:teuthology.orchestra.run.trial162.stdout:Waiting for mgr epoch 9... 2026-02-17T12:18:54.674 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.448+0000 7f4c0a8d4140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:18:54.674 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.596+0000 7f4c0a8d4140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:18:54.674 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.631+0000 7f4c0a8d4140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:18:54.674 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.673+0000 7f4c0a8d4140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:18:54.963 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.704+0000 7f4c0a8d4140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:18:54.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.739+0000 7f4c0a8d4140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:18:54.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.804+0000 7f4c0a8d4140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:18:54.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:18:54.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:18:54.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: from numpy import show_config as show_numpy_config 2026-02-17T12:18:54.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.878+0000 7f4c0a8d4140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:18:54.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:54 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:54.912+0000 7f4c0a8d4140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:18:55.435 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/300079275' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-17T12:18:55.435 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-mon[39588]: mgrmap e9: a(active, since 6s) 2026-02-17T12:18:55.435 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2787952772' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T12:18:55.435 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.007+0000 7f4c0a8d4140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:18:55.436 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.067+0000 7f4c0a8d4140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:18:55.436 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.101+0000 7f4c0a8d4140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:18:55.436 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.133+0000 7f4c0a8d4140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:18:55.436 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.168+0000 7f4c0a8d4140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:18:55.436 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.198+0000 7f4c0a8d4140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:18:55.436 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.434+0000 7f4c0a8d4140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:18:55.688 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.533+0000 7f4c0a8d4140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:18:55.689 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.564+0000 7f4c0a8d4140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:18:55.689 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.595+0000 7f4c0a8d4140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:18:55.689 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.688+0000 7f4c0a8d4140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:18:55.963 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.716+0000 7f4c0a8d4140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:18:55.963 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:55 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:55.808+0000 7f4c0a8d4140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:18:56.706 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:56.272+0000 7f4c0a8d4140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:18:56.706 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:56.303+0000 7f4c0a8d4140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:18:56.706 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:18:56.705+0000 7f4c0a8d4140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:18:56.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: Active manager daemon a restarted 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: Activating manager daemon a 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: osdmap e3: 0 total, 0 up, 0 in 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: mgrmap e10: a(active, starting, since 0.00275398s) 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T12:18:56.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T12:18:56.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: Manager daemon a is now available 2026-02-17T12:18:56.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:18:56.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T12:18:56.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T12:18:57.838 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:18:57.839 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-17T12:18:57.839 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T12:18:57.839 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:18:57.839 INFO:teuthology.orchestra.run.trial162.stdout:mgr epoch 9 is available 2026-02-17T12:18:57.839 INFO:teuthology.orchestra.run.trial162.stdout:Generating a dashboard self-signed certificate... 2026-02-17T12:18:58.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: mgrmap e11: a(active, since 1.00423s) 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:57] ENGINE Bus STARTING 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:57] ENGINE Serving on https://10.20.193.162:7150 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:57] ENGINE Client ('10.20.193.162', 50394) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:58] ENGINE Serving on http://10.20.193.162:8765 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: [17/Feb/2026:12:18:58] ENGINE Bus STARTED 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:18:58.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:58 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:18:58.222 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-17T12:18:58.223 INFO:teuthology.orchestra.run.trial162.stdout:Creating initial admin user... 2026-02-17T12:18:58.704 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$HGB2bdzmO4/moeF2pnu00.oLW/anJwBhfU/HgkT7B3p0yoXz4oaY2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771330738, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-17T12:18:58.704 INFO:teuthology.orchestra.run.trial162.stdout:Fetching dashboard port number... 2026-02-17T12:18:59.031 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stdout 8443 2026-02-17T12:18:59.039 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:18:59.040 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout disabled 2026-02-17T12:18:59.045 INFO:teuthology.orchestra.run.trial162.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:18:59.045 INFO:teuthology.orchestra.run.trial162.stdout:systemctl: stdout inactive 2026-02-17T12:18:59.045 INFO:teuthology.orchestra.run.trial162.stdout:firewalld.service is not enabled 2026-02-17T12:18:59.046 INFO:teuthology.orchestra.run.trial162.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-17T12:18:59.046 INFO:teuthology.orchestra.run.trial162.stdout:Ceph Dashboard is now available at: 2026-02-17T12:18:59.046 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.047 INFO:teuthology.orchestra.run.trial162.stdout: URL: https://trial162:8443/ 2026-02-17T12:18:59.047 INFO:teuthology.orchestra.run.trial162.stdout: User: admin 2026-02-17T12:18:59.047 INFO:teuthology.orchestra.run.trial162.stdout: Password: xtc1nuj93r 2026-02-17T12:18:59.047 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.047 INFO:teuthology.orchestra.run.trial162.stdout:Saving cluster configuration to /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/config directory 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout:Or, if you are only running a single cluster on this host: 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-17T12:18:59.425 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout: ceph telemetry on 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout:For more information see: 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:18:59.426 INFO:teuthology.orchestra.run.trial162.stdout:Bootstrap complete. 2026-02-17T12:18:59.450 INFO:tasks.cephadm:Fetching config... 2026-02-17T12:18:59.450 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:59.450 DEBUG:teuthology.orchestra.run.trial162:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-17T12:18:59.468 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-17T12:18:59.469 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:59.469 DEBUG:teuthology.orchestra.run.trial162:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-17T12:18:59.527 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-17T12:18:59.527 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:59.527 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-17T12:18:59.593 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-17T12:18:59.594 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:18:59.594 DEBUG:teuthology.orchestra.run.trial162:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-17T12:18:59.651 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-17T12:18:59.651 DEBUG:teuthology.orchestra.run.trial162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJvobM6eBiXqYVg31SddDjcd1nvayiFGoakx4eddFhLy ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T12:18:59.693 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:59 trial162 ceph-mon[39588]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:18:59.693 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:59 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:18:59.694 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:59 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4234613731' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-17T12:18:59.694 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:18:59 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/504346305' entity='client.admin' 2026-02-17T12:18:59.723 INFO:teuthology.orchestra.run.trial162.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJvobM6eBiXqYVg31SddDjcd1nvayiFGoakx4eddFhLy ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:18:59.734 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-17T12:18:59.919 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:00.269 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-17T12:19:00.269 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-17T12:19:00.417 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:00.775 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: mgrmap e12: a(active, since 2s) 2026-02-17T12:19:00.775 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:00.775 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:00.775 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial162", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:19:00.775 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:00.776 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:00.776 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:00.776 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2546038789' entity='client.admin' 2026-02-17T12:19:00.776 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:00.776 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:00 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:00.795 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-17T12:19:00.796 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd crush tunables default 2026-02-17T12:19:00.943 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:01.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:19:01.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:01.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:01.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:01.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:01.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: Updating trial162:/etc/ceph/ceph.conf 2026-02-17T12:19:01.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: Updating trial162:/var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/config/ceph.conf 2026-02-17T12:19:01.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: Updating trial162:/etc/ceph/ceph.client.admin.keyring 2026-02-17T12:19:01.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: Updating trial162:/var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T12:19:01.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:01.965 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:01.966 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:01.966 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:01 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3105962776' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-17T12:19:02.122 INFO:teuthology.orchestra.run.trial162.stderr:adjusted tunables profile to default 2026-02-17T12:19:02.267 INFO:tasks.cephadm:Adding mon.a on trial162 2026-02-17T12:19:02.268 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph orch apply mon '1;trial162:10.20.193.162=a' 2026-02-17T12:19:02.413 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:02.635 INFO:teuthology.orchestra.run.trial162.stdout:Scheduled mon update... 2026-02-17T12:19:02.772 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-17T12:19:02.773 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T12:19:03.019 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:03.258 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:03.259 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":1,"fsid":"c0fec2e3-0bfa-11f1-8517-d404e6e7d460","modified":"2026-02-17T12:18:35.232742Z","created":"2026-02-17T12:18:35.232742Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:3300","nonce":0},{"type":"v1","addr":"10.20.193.162:6789","nonce":0}]},"addr":"10.20.193.162:6789/0","public_addr":"10.20.193.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T12:19:03.259 INFO:teuthology.orchestra.run.trial162.stderr:dumped monmap epoch 1 2026-02-17T12:19:03.376 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3105962776' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-17T12:19:03.376 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: osdmap e4: 0 total, 0 up, 0 in 2026-02-17T12:19:03.376 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial162:10.20.193.162=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: Saving service mon spec with placement trial162:10.20.193.162=a;count:1 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.377 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: Reconfiguring mon.a (unknown last config time)... 2026-02-17T12:19:03.378 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T12:19:03.378 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T12:19:03.378 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:03.378 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: Reconfiguring daemon mon.a on trial162 2026-02-17T12:19:03.378 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.378 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:03 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:03.398 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-17T12:19:03.398 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-17T12:19:03.551 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:03.763 INFO:teuthology.orchestra.run.trial162.stdout:# minimal ceph.conf for c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:19:03.764 INFO:teuthology.orchestra.run.trial162.stdout:[global] 2026-02-17T12:19:03.764 INFO:teuthology.orchestra.run.trial162.stdout: fsid = c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:19:03.764 INFO:teuthology.orchestra.run.trial162.stdout: mon_host = [v2:10.20.193.162:3300/0,v1:10.20.193.162:6789/0] 2026-02-17T12:19:03.902 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-17T12:19:03.902 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:19:03.902 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T12:19:03.928 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:19:03.928 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T12:19:03.992 INFO:tasks.cephadm:Adding mgr.a on trial162 2026-02-17T12:19:03.993 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph orch apply mgr '1;trial162=a' 2026-02-17T12:19:04.178 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:04.200 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:04 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3940264274' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T12:19:04.200 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:04 trial162 ceph-mon[39588]: mgrmap e13: a(active, since 6s) 2026-02-17T12:19:04.200 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:04 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3326257995' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:04.406 INFO:teuthology.orchestra.run.trial162.stdout:Scheduled mgr update... 2026-02-17T12:19:04.546 INFO:tasks.cephadm:Deploying OSDs... 2026-02-17T12:19:04.546 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:19:04.546 DEBUG:teuthology.orchestra.run.trial162:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T12:19:04.564 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T12:19:04.564 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_1 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 12:19:00.398459842 +0000 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 12:16:08.528857429 +0000 2026-02-17T12:19:04.623 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 12:16:08.528857429 +0000 2026-02-17T12:19:04.624 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 12:16:08.528857429 +0000 2026-02-17T12:19:04.624 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T12:19:04.689 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T12:19:04.689 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T12:19:04.689 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000187248 s, 2.7 MB/s 2026-02-17T12:19:04.690 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T12:19:04.748 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_2 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 12:19:00.398459842 +0000 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 12:16:08.528857429 +0000 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 12:16:08.528857429 +0000 2026-02-17T12:19:04.803 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 12:16:08.528857429 +0000 2026-02-17T12:19:04.803 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T12:19:04.866 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T12:19:04.866 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T12:19:04.866 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000149658 s, 3.4 MB/s 2026-02-17T12:19:04.868 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T12:19:04.924 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_3 2026-02-17T12:19:04.980 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T12:19:04.981 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:19:04.981 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-17T12:19:04.981 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:19:04.981 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:19:04.981 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 12:19:00.398459842 +0000 2026-02-17T12:19:04.981 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 12:16:08.527857446 +0000 2026-02-17T12:19:04.981 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 12:16:08.527857446 +0000 2026-02-17T12:19:04.982 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 12:16:08.527857446 +0000 2026-02-17T12:19:04.982 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T12:19:05.044 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T12:19:05.044 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T12:19:05.044 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000148285 s, 3.5 MB/s 2026-02-17T12:19:05.045 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T12:19:05.104 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_4 2026-02-17T12:19:05.161 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-17 12:19:00.398459842 +0000 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-17 12:16:08.526857463 +0000 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-17 12:16:08.526857463 +0000 2026-02-17T12:19:05.162 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-17 12:16:08.526857463 +0000 2026-02-17T12:19:05.163 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T12:19:05.224 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-17T12:19:05.224 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-17T12:19:05.224 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000155509 s, 3.3 MB/s 2026-02-17T12:19:05.225 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T12:19:05.282 INFO:tasks.cephadm:Deploying osd.0 on trial162 with /dev/vg_nvme/lv_4... 2026-02-17T12:19:05.283 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-17T12:19:05.469 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:05.493 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial162=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:19:05.493 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: Saving service mgr spec with placement trial162=a;count:1 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: Reconfiguring mgr.a (unknown last config time)... 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:05.494 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: Reconfiguring daemon mgr.a on trial162 2026-02-17T12:19:05.495 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:05.495 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:05 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:06.423 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:06.438 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph orch daemon add osd trial162:vg_nvme/lv_4 2026-02-17T12:19:06.587 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:06.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:06 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T12:19:06.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:06 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T12:19:06.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:06 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:07.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:07 trial162 ceph-mon[39588]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:19:07.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:07 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/131059620' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf51348f-8728-4c74-8b61-05f939b4937a"}]: dispatch 2026-02-17T12:19:07.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:07 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/131059620' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf51348f-8728-4c74-8b61-05f939b4937a"}]': finished 2026-02-17T12:19:07.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:07 trial162 ceph-mon[39588]: osdmap e5: 1 total, 0 up, 1 in 2026-02-17T12:19:07.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:07 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:19:09.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:08 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/357488607' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T12:19:11.770 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:11 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T12:19:11.770 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:11 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:12.710 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:12 trial162 ceph-mon[39588]: Deploying daemon osd.0 on trial162 2026-02-17T12:19:14.155 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:13 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:14.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:13 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:14.156 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:13 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:15.136 INFO:teuthology.orchestra.run.trial162.stdout:Created osd(s) 0 on host 'trial162' 2026-02-17T12:19:15.299 DEBUG:teuthology.orchestra.run.trial162:osd.0> sudo journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.0.service 2026-02-17T12:19:15.301 INFO:tasks.cephadm:Deploying osd.1 on trial162 with /dev/vg_nvme/lv_3... 2026-02-17T12:19:15.301 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-17T12:19:15.514 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:15.535 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:15 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:16.109 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:15 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0[52627]: 2026-02-17T12:19:15.810+0000 7fbcd951b740 -1 Falling back to public interface 2026-02-17T12:19:16.843 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:16.858 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph orch daemon add osd trial162:vg_nvme/lv_3 2026-02-17T12:19:17.007 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: Detected new or changed devices on trial162 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: Adjusting osd_memory_target on trial162 to 84047M 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:17.404 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:17 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:18.326 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:19:18.326 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T12:19:18.327 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T12:19:18.327 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:18.327 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2503770732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "133b006c-74fb-4834-8d7d-c0d2ff35754b"}]: dispatch 2026-02-17T12:19:18.327 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2503770732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "133b006c-74fb-4834-8d7d-c0d2ff35754b"}]': finished 2026-02-17T12:19:18.327 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: osdmap e6: 2 total, 0 up, 2 in 2026-02-17T12:19:18.327 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:19:18.327 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:18 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:19.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:19 trial162 ceph-mon[39588]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:19:19.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:19 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3928459520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T12:19:19.463 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:19 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0[52627]: 2026-02-17T12:19:19.088+0000 7fbcd951b740 -1 osd.0 0 log_to_monitors true 2026-02-17T12:19:20.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:20 trial162 ceph-mon[39588]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:19:20.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:20 trial162 ceph-mon[39588]: from='osd.0 [v2:10.20.193.162:6802/3830091846,v1:10.20.193.162:6803/3830091846]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T12:19:21.414 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:21 trial162 ceph-mon[39588]: from='osd.0 [v2:10.20.193.162:6802/3830091846,v1:10.20.193.162:6803/3830091846]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T12:19:21.414 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:21 trial162 ceph-mon[39588]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T12:19:21.414 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:21 trial162 ceph-mon[39588]: from='osd.0 [v2:10.20.193.162:6802/3830091846,v1:10.20.193.162:6803/3830091846]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial162", "root=default"]}]: dispatch 2026-02-17T12:19:21.414 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:21 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:19:21.414 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:21 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:21.414 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:21 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0[52627]: 2026-02-17T12:19:21.238+0000 7fbcd549c640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T12:19:21.415 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:21 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0[52627]: 2026-02-17T12:19:21.241+0000 7fbccd2be640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:19:22.207 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:22 trial162 ceph-mon[39588]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:19:22.207 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:22 trial162 ceph-mon[39588]: from='osd.0 [v2:10.20.193.162:6802/3830091846,v1:10.20.193.162:6803/3830091846]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial162", "root=default"]}]': finished 2026-02-17T12:19:22.207 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:22 trial162 ceph-mon[39588]: osdmap e8: 2 total, 0 up, 2 in 2026-02-17T12:19:22.208 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:22 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:19:22.208 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:22 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:22.208 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:22 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T12:19:22.208 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:22 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:23.100 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: purged_snaps scrub starts 2026-02-17T12:19:23.101 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: purged_snaps scrub ok 2026-02-17T12:19:23.101 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: OSD bench result of 92770.279173 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T12:19:23.101 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: Deploying daemon osd.1 on trial162 2026-02-17T12:19:23.101 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: osd.0 [v2:10.20.193.162:6802/3830091846,v1:10.20.193.162:6803/3830091846] boot 2026-02-17T12:19:23.101 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: osdmap e9: 2 total, 1 up, 2 in 2026-02-17T12:19:23.101 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:19:23.101 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:23 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:24.279 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:24 trial162 ceph-mon[39588]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:19:24.279 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:24 trial162 ceph-mon[39588]: osdmap e10: 2 total, 1 up, 2 in 2026-02-17T12:19:24.280 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:24 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:25.427 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:25.427 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:25.427 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:25.427 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:25.427 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:25.427 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:25.428 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:25.428 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:25 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:25.453 INFO:teuthology.orchestra.run.trial162.stdout:Created osd(s) 1 on host 'trial162' 2026-02-17T12:19:25.593 DEBUG:teuthology.orchestra.run.trial162:osd.1> sudo journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.1.service 2026-02-17T12:19:25.595 INFO:tasks.cephadm:Deploying osd.2 on trial162 with /dev/vg_nvme/lv_2... 2026-02-17T12:19:25.596 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-17T12:19:25.831 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:26.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:26 trial162 ceph-mon[39588]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:19:26.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:26 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:26.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:26 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:26.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:26 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:26.214 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:25 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1[58207]: 2026-02-17T12:19:25.940+0000 7f8a54d4e740 -1 Falling back to public interface 2026-02-17T12:19:27.207 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:27.222 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph orch daemon add osd trial162:vg_nvme/lv_2 2026-02-17T12:19:27.374 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:27.713 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: Detected new or changed devices on trial162 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: Adjusting osd_memory_target on trial162 to 42023M 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:27.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:27.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:27 trial162 ceph-mon[39588]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:19:28.671 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:28 trial162 ceph-mon[39588]: from='client.14201 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:19:28.671 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:28 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T12:19:28.671 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:28 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T12:19:28.671 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:28 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:28.963 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:28 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1[58207]: 2026-02-17T12:19:28.754+0000 7f8a54d4e740 -1 osd.1 0 log_to_monitors true 2026-02-17T12:19:29.713 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1001677258' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ac81835-d767-4393-a969-528b30c4ef5b"}]: dispatch 2026-02-17T12:19:29.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1001677258' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ac81835-d767-4393-a969-528b30c4ef5b"}]': finished 2026-02-17T12:19:29.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: osdmap e11: 3 total, 1 up, 3 in 2026-02-17T12:19:29.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:29.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:29.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1039890401' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T12:19:29.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:19:29.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:29 trial162 ceph-mon[39588]: from='osd.1 [v2:10.20.193.162:6810/2877387891,v1:10.20.193.162:6811/2877387891]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T12:19:30.713 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:30 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1[58207]: 2026-02-17T12:19:30.415+0000 7f8a50ccf640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T12:19:30.714 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:30 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1[58207]: 2026-02-17T12:19:30.417+0000 7f8a4caf9640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:19:30.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:30 trial162 ceph-mon[39588]: from='osd.1 [v2:10.20.193.162:6810/2877387891,v1:10.20.193.162:6811/2877387891]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T12:19:30.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:30 trial162 ceph-mon[39588]: osdmap e12: 3 total, 1 up, 3 in 2026-02-17T12:19:30.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:30 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:30.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:30 trial162 ceph-mon[39588]: from='osd.1 [v2:10.20.193.162:6810/2877387891,v1:10.20.193.162:6811/2877387891]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial162", "root=default"]}]: dispatch 2026-02-17T12:19:30.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:30 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:31.695 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:31 trial162 ceph-mon[39588]: from='osd.1 [v2:10.20.193.162:6810/2877387891,v1:10.20.193.162:6811/2877387891]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial162", "root=default"]}]': finished 2026-02-17T12:19:31.695 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:31 trial162 ceph-mon[39588]: osdmap e13: 3 total, 1 up, 3 in 2026-02-17T12:19:31.695 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:31 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:31.695 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:31 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:31.696 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:31 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:31.696 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:31 trial162 ceph-mon[39588]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:19:32.604 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:32 trial162 ceph-mon[39588]: purged_snaps scrub starts 2026-02-17T12:19:32.604 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:32 trial162 ceph-mon[39588]: purged_snaps scrub ok 2026-02-17T12:19:32.604 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:32 trial162 ceph-mon[39588]: osd.1 [v2:10.20.193.162:6810/2877387891,v1:10.20.193.162:6811/2877387891] boot 2026-02-17T12:19:32.605 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:32 trial162 ceph-mon[39588]: osdmap e14: 3 total, 2 up, 3 in 2026-02-17T12:19:32.605 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:32 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:19:32.605 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:32 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:33.634 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:33 trial162 ceph-mon[39588]: osdmap e15: 3 total, 2 up, 3 in 2026-02-17T12:19:33.634 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:33 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:33.634 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:33 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T12:19:33.634 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:33 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:33.634 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:33 trial162 ceph-mon[39588]: Deploying daemon osd.2 on trial162 2026-02-17T12:19:33.634 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:33 trial162 ceph-mon[39588]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:19:36.035 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:19:36.035 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:36.035 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:36.036 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:36.036 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:36.036 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:36.036 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:36.036 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:36.036 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:35 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:36.061 INFO:teuthology.orchestra.run.trial162.stdout:Created osd(s) 2 on host 'trial162' 2026-02-17T12:19:36.202 DEBUG:teuthology.orchestra.run.trial162:osd.2> sudo journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.2.service 2026-02-17T12:19:36.204 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2026-02-17T12:19:36.204 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:19:36.443 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:36.558 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:36 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2[63782]: 2026-02-17T12:19:36.354+0000 7fade39a8740 -1 Falling back to public interface 2026-02-17T12:19:36.661 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:36.801 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771330771,"num_in_osds":3,"osd_in_since":1771330768,"num_remapped_pgs":0} 2026-02-17T12:19:36.907 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:36 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:36.908 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:36 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:36.908 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:36 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:36.908 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:36 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3132317014' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:19:37.803 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:19:37.957 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: Detected new or changed devices on trial162 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: Adjusting osd_memory_target on trial162 to 28015M 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:38.115 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:38.116 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:38 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:38.177 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:38.316 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771330771,"num_in_osds":3,"osd_in_since":1771330768,"num_remapped_pgs":0} 2026-02-17T12:19:39.317 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:19:39.341 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:39 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2581408463' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:19:39.341 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2[63782]: 2026-02-17T12:19:39.141+0000 7fade39a8740 -1 osd.2 0 log_to_monitors true 2026-02-17T12:19:39.469 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:39.687 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:39.824 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771330771,"num_in_osds":3,"osd_in_since":1771330768,"num_remapped_pgs":0} 2026-02-17T12:19:40.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:40 trial162 ceph-mon[39588]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:19:40.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:40 trial162 ceph-mon[39588]: from='osd.2 [v2:10.20.193.162:6818/712883298,v1:10.20.193.162:6819/712883298]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T12:19:40.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:40 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2432841630' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:19:40.826 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:19:40.976 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:41.190 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:41.190 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:41 trial162 ceph-mon[39588]: from='osd.2 [v2:10.20.193.162:6818/712883298,v1:10.20.193.162:6819/712883298]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T12:19:41.191 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:41 trial162 ceph-mon[39588]: osdmap e16: 3 total, 2 up, 3 in 2026-02-17T12:19:41.191 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:41 trial162 ceph-mon[39588]: from='osd.2 [v2:10.20.193.162:6818/712883298,v1:10.20.193.162:6819/712883298]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial162", "root=default"]}]: dispatch 2026-02-17T12:19:41.191 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:41 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:41.191 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:41 trial162 ceph-mon[39588]: from='osd.2 [v2:10.20.193.162:6818/712883298,v1:10.20.193.162:6819/712883298]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial162", "root=default"]}]': finished 2026-02-17T12:19:41.191 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:41 trial162 ceph-mon[39588]: osdmap e17: 3 total, 2 up, 3 in 2026-02-17T12:19:41.191 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:41 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:41.191 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:41 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2[63782]: 2026-02-17T12:19:41.060+0000 7faddf929640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T12:19:41.192 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:41 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2[63782]: 2026-02-17T12:19:41.063+0000 7faddb753640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:19:41.330 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":17,"num_osds":3,"num_up_osds":2,"osd_up_since":1771330771,"num_in_osds":3,"osd_in_since":1771330768,"num_remapped_pgs":0} 2026-02-17T12:19:42.331 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:19:42.356 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:42 trial162 ceph-mon[39588]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:19:42.356 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:42 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:42.356 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:42 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2867447435' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:19:42.356 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:42 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:42.481 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:42.692 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:42.831 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1771330782,"num_in_osds":3,"osd_in_since":1771330768,"num_remapped_pgs":0} 2026-02-17T12:19:42.832 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T12:19:43.022 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:43.235 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:43.235 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":19,"fsid":"c0fec2e3-0bfa-11f1-8517-d404e6e7d460","created":"2026-02-17T12:18:36.418342+0000","modified":"2026-02-17T12:19:43.066189+0000","last_up_change":"2026-02-17T12:19:42.062336+0000","last_in_change":"2026-02-17T12:19:28.408588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:19:42.738261+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf51348f-8728-4c74-8b61-05f939b4937a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6802","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6803","nonce":3830091846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6804","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6805","nonce":3830091846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6808","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6809","nonce":3830091846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6806","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6807","nonce":3830091846}]},"public_addr":"10.20.193.162:6803/3830091846","cluster_addr":"10.20.193.162:6805/3830091846","heartbeat_back_addr":"10.20.193.162:6809/3830091846","heartbeat_front_addr":"10.20.193.162:6807/3830091846","state":["exists","up"]},{"osd":1,"uuid":"133b006c-74fb-4834-8d7d-c0d2ff35754b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6810","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6811","nonce":2877387891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6812","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6813","nonce":2877387891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6816","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6817","nonce":2877387891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6814","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6815","nonce":2877387891}]},"public_addr":"10.20.193.162:6811/2877387891","cluster_addr":"10.20.193.162:6813/2877387891","heartbeat_back_addr":"10.20.193.162:6817/2877387891","heartbeat_front_addr":"10.20.193.162:6815/2877387891","state":["exists","up"]},{"osd":2,"uuid":"0ac81835-d767-4393-a969-528b30c4ef5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6818","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6819","nonce":712883298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6820","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6821","nonce":712883298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6824","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6825","nonce":712883298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6822","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6823","nonce":712883298}]},"public_addr":"10.20.193.162:6819/712883298","cluster_addr":"10.20.193.162:6821/712883298","heartbeat_back_addr":"10.20.193.162:6825/712883298","heartbeat_front_addr":"10.20.193.162:6823/712883298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:20.089866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:29.708372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:40.144843+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.162:0/2047647419":"2026-02-18T12:18:56.707126+0000","10.20.193.162:6800/1738738496":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/2620057420":"2026-02-18T12:18:56.707126+0000","10.20.193.162:6801/2598679984":"2026-02-18T12:18:47.361265+0000","10.20.193.162:6800/2598679984":"2026-02-18T12:18:47.361265+0000","10.20.193.162:6801/1738738496":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/868908951":"2026-02-18T12:18:47.361265+0000","10.20.193.162:0/797661813":"2026-02-18T12:18:47.361265+0000","10.20.193.162:0/3841361353":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/3040960267":"2026-02-18T12:18:47.361265+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:19:43.353 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:43 trial162 ceph-mon[39588]: purged_snaps scrub starts 2026-02-17T12:19:43.353 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:43 trial162 ceph-mon[39588]: purged_snaps scrub ok 2026-02-17T12:19:43.353 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:43 trial162 ceph-mon[39588]: osd.2 [v2:10.20.193.162:6818/712883298,v1:10.20.193.162:6819/712883298] boot 2026-02-17T12:19:43.353 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:43 trial162 ceph-mon[39588]: osdmap e18: 3 total, 3 up, 3 in 2026-02-17T12:19:43.353 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:43 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:19:43.354 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:43 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/28588246' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:19:43.354 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:43 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T12:19:43.374 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-17T12:19:42.738261+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T12:19:43.375 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-17T12:19:43.527 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:43.744 INFO:teuthology.orchestra.run.trial162.stdout:pg_num: 1 2026-02-17T12:19:43.881 INFO:tasks.cephadm:Setting up client nodes... 2026-02-17T12:19:43.882 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T12:19:44.028 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:44.141 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 ceph-mon[39588]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:19:44.141 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T12:19:44.141 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 ceph-mon[39588]: osdmap e19: 3 total, 3 up, 3 in 2026-02-17T12:19:44.142 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T12:19:44.142 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1568272288' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:19:44.142 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1312891936' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-17T12:19:44.275 INFO:teuthology.orchestra.run.trial162.stdout:[client.0] 2026-02-17T12:19:44.275 INFO:teuthology.orchestra.run.trial162.stdout: key = AQDgXJRpN/NdEBAA2uh+tzWM3K/DvF0VTvIsHw== 2026-02-17T12:19:44.392 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68134]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T12:19:44.392 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68134]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.392 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.392 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68134]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.392 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68138]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T12:19:44.392 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68138]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.392 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68126]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68126]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68130]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68130]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.393 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68130]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.414 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:19:44.414 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-17T12:19:44.414 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T12:19:44.449 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T12:19:44.449 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-17T12:19:44.449 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-17T12:19:44.639 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:44.661 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68138]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68176]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68176]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68176]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68182]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68182]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.662 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68182]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68142]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68142]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68142]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68149]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68149]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:19:44.662 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:19:44 trial162 sudo[68149]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:19:44.874 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:45.012 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6800","nonce":56023730},{"type":"v1","addr":"10.20.193.162:6801","nonce":56023730}]},"active_addr":"10.20.193.162:6801/56023730","active_change":"2026-02-17T12:18:56.707217+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.162:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":2398536175}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":143662916}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":2358119296}]}]} 2026-02-17T12:19:45.017 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-17T12:19:45.017 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-17T12:19:45.017 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T12:19:45.167 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:45.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T12:19:45.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: osdmap e20: 3 total, 3 up, 3 in 2026-02-17T12:19:45.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/343088524' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T12:19:45.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/343088524' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T12:19:45.216 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:45.216 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:45.216 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T12:19:45.216 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T12:19:45.216 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:19:45.216 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:45 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/139873953' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T12:19:45.378 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:45.378 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":21,"fsid":"c0fec2e3-0bfa-11f1-8517-d404e6e7d460","created":"2026-02-17T12:18:36.418342+0000","modified":"2026-02-17T12:19:45.275224+0000","last_up_change":"2026-02-17T12:19:42.062336+0000","last_in_change":"2026-02-17T12:19:28.408588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:19:42.738261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf51348f-8728-4c74-8b61-05f939b4937a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6802","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6803","nonce":3830091846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6804","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6805","nonce":3830091846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6808","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6809","nonce":3830091846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6806","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6807","nonce":3830091846}]},"public_addr":"10.20.193.162:6803/3830091846","cluster_addr":"10.20.193.162:6805/3830091846","heartbeat_back_addr":"10.20.193.162:6809/3830091846","heartbeat_front_addr":"10.20.193.162:6807/3830091846","state":["exists","up"]},{"osd":1,"uuid":"133b006c-74fb-4834-8d7d-c0d2ff35754b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6810","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6811","nonce":2877387891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6812","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6813","nonce":2877387891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6816","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6817","nonce":2877387891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6814","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6815","nonce":2877387891}]},"public_addr":"10.20.193.162:6811/2877387891","cluster_addr":"10.20.193.162:6813/2877387891","heartbeat_back_addr":"10.20.193.162:6817/2877387891","heartbeat_front_addr":"10.20.193.162:6815/2877387891","state":["exists","up"]},{"osd":2,"uuid":"0ac81835-d767-4393-a969-528b30c4ef5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6818","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6819","nonce":712883298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6820","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6821","nonce":712883298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6824","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6825","nonce":712883298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6822","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6823","nonce":712883298}]},"public_addr":"10.20.193.162:6819/712883298","cluster_addr":"10.20.193.162:6821/712883298","heartbeat_back_addr":"10.20.193.162:6825/712883298","heartbeat_front_addr":"10.20.193.162:6823/712883298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:20.089866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:29.708372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:40.144843+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.162:0/2047647419":"2026-02-18T12:18:56.707126+0000","10.20.193.162:6800/1738738496":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/2620057420":"2026-02-18T12:18:56.707126+0000","10.20.193.162:6801/2598679984":"2026-02-18T12:18:47.361265+0000","10.20.193.162:6800/2598679984":"2026-02-18T12:18:47.361265+0000","10.20.193.162:6801/1738738496":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/868908951":"2026-02-18T12:18:47.361265+0000","10.20.193.162:0/797661813":"2026-02-18T12:18:47.361265+0000","10.20.193.162:0/3841361353":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/3040960267":"2026-02-18T12:18:47.361265+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:19:45.516 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-17T12:19:45.517 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T12:19:45.666 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:45.880 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:45.881 INFO:teuthology.orchestra.run.trial162.stdout:{"epoch":21,"fsid":"c0fec2e3-0bfa-11f1-8517-d404e6e7d460","created":"2026-02-17T12:18:36.418342+0000","modified":"2026-02-17T12:19:45.275224+0000","last_up_change":"2026-02-17T12:19:42.062336+0000","last_in_change":"2026-02-17T12:19:28.408588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:19:42.738261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf51348f-8728-4c74-8b61-05f939b4937a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6802","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6803","nonce":3830091846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6804","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6805","nonce":3830091846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6808","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6809","nonce":3830091846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6806","nonce":3830091846},{"type":"v1","addr":"10.20.193.162:6807","nonce":3830091846}]},"public_addr":"10.20.193.162:6803/3830091846","cluster_addr":"10.20.193.162:6805/3830091846","heartbeat_back_addr":"10.20.193.162:6809/3830091846","heartbeat_front_addr":"10.20.193.162:6807/3830091846","state":["exists","up"]},{"osd":1,"uuid":"133b006c-74fb-4834-8d7d-c0d2ff35754b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6810","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6811","nonce":2877387891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6812","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6813","nonce":2877387891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6816","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6817","nonce":2877387891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6814","nonce":2877387891},{"type":"v1","addr":"10.20.193.162:6815","nonce":2877387891}]},"public_addr":"10.20.193.162:6811/2877387891","cluster_addr":"10.20.193.162:6813/2877387891","heartbeat_back_addr":"10.20.193.162:6817/2877387891","heartbeat_front_addr":"10.20.193.162:6815/2877387891","state":["exists","up"]},{"osd":2,"uuid":"0ac81835-d767-4393-a969-528b30c4ef5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6818","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6819","nonce":712883298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6820","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6821","nonce":712883298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6824","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6825","nonce":712883298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.162:6822","nonce":712883298},{"type":"v1","addr":"10.20.193.162:6823","nonce":712883298}]},"public_addr":"10.20.193.162:6819/712883298","cluster_addr":"10.20.193.162:6821/712883298","heartbeat_back_addr":"10.20.193.162:6825/712883298","heartbeat_front_addr":"10.20.193.162:6823/712883298","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:20.089866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:29.708372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:19:40.144843+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.162:0/2047647419":"2026-02-18T12:18:56.707126+0000","10.20.193.162:6800/1738738496":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/2620057420":"2026-02-18T12:18:56.707126+0000","10.20.193.162:6801/2598679984":"2026-02-18T12:18:47.361265+0000","10.20.193.162:6800/2598679984":"2026-02-18T12:18:47.361265+0000","10.20.193.162:6801/1738738496":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/868908951":"2026-02-18T12:18:47.361265+0000","10.20.193.162:0/797661813":"2026-02-18T12:18:47.361265+0000","10.20.193.162:0/3841361353":"2026-02-18T12:18:56.707126+0000","10.20.193.162:0/3040960267":"2026-02-18T12:18:47.361265+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:19:46.022 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-17T12:19:46.023 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-17T12:19:46.023 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-17T12:19:46.188 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:46.189 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:46.189 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:46.260 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:46 trial162 ceph-mon[39588]: pgmap v34: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:19:46.260 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:46 trial162 ceph-mon[39588]: osdmap e21: 3 total, 3 up, 3 in 2026-02-17T12:19:46.260 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:46 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3763514203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:19:46.260 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:46 trial162 ceph-mon[39588]: mgrmap e14: a(active, since 48s) 2026-02-17T12:19:46.260 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:46 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/735280526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:19:46.461 INFO:teuthology.orchestra.run.trial162.stdout:60129542150 2026-02-17T12:19:46.462 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T12:19:46.463 INFO:teuthology.orchestra.run.trial162.stdout:77309411331 2026-02-17T12:19:46.463 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T12:19:46.468 INFO:teuthology.orchestra.run.trial162.stdout:38654705672 2026-02-17T12:19:46.468 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T12:19:46.610 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:46.718 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:46.719 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:46.828 INFO:teuthology.orchestra.run.trial162.stdout:60129542149 2026-02-17T12:19:46.942 INFO:teuthology.orchestra.run.trial162.stdout:77309411330 2026-02-17T12:19:46.945 INFO:teuthology.orchestra.run.trial162.stdout:38654705671 2026-02-17T12:19:46.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2026-02-17T12:19:47.084 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411331 got 77309411330 for osd.2 2026-02-17T12:19:47.086 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.0 2026-02-17T12:19:47.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:47 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1003407865' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T12:19:47.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:47 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2593178163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T12:19:47.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:47 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/138188341' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T12:19:47.970 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T12:19:48.085 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T12:19:48.086 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T12:19:48.118 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:48.244 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:48.244 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:48.266 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:48 trial162 ceph-mon[39588]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:19:48.341 INFO:teuthology.orchestra.run.trial162.stdout:60129542150 2026-02-17T12:19:48.463 INFO:teuthology.orchestra.run.trial162.stdout:77309411331 2026-02-17T12:19:48.465 INFO:teuthology.orchestra.run.trial162.stdout:38654705672 2026-02-17T12:19:48.484 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2026-02-17T12:19:48.484 DEBUG:teuthology.parallel:result is None 2026-02-17T12:19:48.605 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411331 got 77309411331 for osd.2 2026-02-17T12:19:48.606 DEBUG:teuthology.parallel:result is None 2026-02-17T12:19:48.608 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2026-02-17T12:19:48.608 DEBUG:teuthology.parallel:result is None 2026-02-17T12:19:48.608 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-17T12:19:48.609 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T12:19:48.798 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:49.001 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:49.002 INFO:teuthology.orchestra.run.trial162.stderr:dumped all 2026-02-17T12:19:49.118 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:49 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/478979369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T12:19:49.118 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:49 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/456384226' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T12:19:49.118 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:49 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/977999192' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T12:19:49.138 INFO:teuthology.orchestra.run.trial162.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-17T12:19:48.716088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83916,"kb_used_data":2268,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201925684,"statfs":{"total":2254857830400,"available":2254771900416,"internally_reserved":0,"allocated":2322432,"data_stored":1929540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000251"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-17T12:19:46.144527+0000","last_change":"2026-02-17T12:19:44.295767+0000","last_active":"2026-02-17T12:19:46.144527+0000","last_peered":"2026-02-17T12:19:46.144527+0000","last_clean":"2026-02-17T12:19:46.144527+0000","last_became_active":"2026-02-17T12:19:44.295231+0000","last_became_peered":"2026-02-17T12:19:44.295231+0000","last_unstale":"2026-02-17T12:19:46.144527+0000","last_undegraded":"2026-02-17T12:19:46.144527+0000","last_fullsized":"2026-02-17T12:19:46.144527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:19:43.066189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:19:43.066189+0000","last_clean_scrub_stamp":"2026-02-17T12:19:43.066189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:13:13.993530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:19:49.139 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T12:19:49.285 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:49.493 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:49.494 INFO:teuthology.orchestra.run.trial162.stderr:dumped all 2026-02-17T12:19:49.631 INFO:teuthology.orchestra.run.trial162.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-17T12:19:48.716088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83916,"kb_used_data":2268,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201925684,"statfs":{"total":2254857830400,"available":2254771900416,"internally_reserved":0,"allocated":2322432,"data_stored":1929540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000251"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-17T12:19:46.144527+0000","last_change":"2026-02-17T12:19:44.295767+0000","last_active":"2026-02-17T12:19:46.144527+0000","last_peered":"2026-02-17T12:19:46.144527+0000","last_clean":"2026-02-17T12:19:46.144527+0000","last_became_active":"2026-02-17T12:19:44.295231+0000","last_became_peered":"2026-02-17T12:19:44.295231+0000","last_unstale":"2026-02-17T12:19:46.144527+0000","last_undegraded":"2026-02-17T12:19:46.144527+0000","last_fullsized":"2026-02-17T12:19:46.144527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:19:43.066189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:19:43.066189+0000","last_clean_scrub_stamp":"2026-02-17T12:19:43.066189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:13:13.993530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:19:49.632 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-17T12:19:49.632 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T12:19:49.632 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-17T12:19:49.632 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph health --format=json 2026-02-17T12:19:49.778 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:50.005 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-17T12:19:50.005 INFO:teuthology.orchestra.run.trial162.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T12:19:50.143 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-17T12:19:50.143 INFO:tasks.cephadm:Setup complete, yielding 2026-02-17T12:19:50.144 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-17T12:19:50.154 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial162.front.sepia.ceph.com 2026-02-17T12:19:50.154 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- bash -c 'ceph osd pool create foo' 2026-02-17T12:19:50.303 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:50.325 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:50 trial162 ceph-mon[39588]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:19:50.325 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:50 trial162 ceph-mon[39588]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:19:50.325 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:50 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3317303484' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T12:19:51.081 INFO:teuthology.orchestra.run.trial162.stderr:pool 'foo' created 2026-02-17T12:19:51.222 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- bash -c 'rbd pool init foo' 2026-02-17T12:19:51.370 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:51.392 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:51 trial162 ceph-mon[39588]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:19:51.393 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:51 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/352281399' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2026-02-17T12:19:52.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:52 trial162 ceph-mon[39588]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:19:52.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:52 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/352281399' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2026-02-17T12:19:52.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:52 trial162 ceph-mon[39588]: osdmap e22: 3 total, 3 up, 3 in 2026-02-17T12:19:52.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:52 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/262721017' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2026-02-17T12:19:53.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:53 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/262721017' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2026-02-17T12:19:53.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:53 trial162 ceph-mon[39588]: osdmap e23: 3 total, 3 up, 3 in 2026-02-17T12:19:54.227 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- bash -c 'ceph orch apply iscsi foo u p' 2026-02-17T12:19:54.373 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:19:54.395 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:54 trial162 ceph-mon[39588]: pgmap v41: 33 pgs: 12 active+clean, 21 unknown; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:19:54.396 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:54 trial162 ceph-mon[39588]: osdmap e24: 3 total, 3 up, 3 in 2026-02-17T12:19:54.592 INFO:teuthology.orchestra.run.trial162.stdout:Scheduled iscsi.foo update... 2026-02-17T12:19:54.731 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T12:19:54.756 INFO:tasks.workunit:Pulling workunits from ref 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:19:54.756 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T12:19:54.757 DEBUG:teuthology.orchestra.run.trial162:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T12:19:54.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:19:54.774 INFO:teuthology.orchestra.run.trial162.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T12:19:54.774 DEBUG:teuthology.orchestra.run.trial162:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T12:19:54.830 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T12:19:54.830 DEBUG:teuthology.orchestra.run.trial162:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T12:19:54.887 INFO:tasks.workunit:timeout=3h 2026-02-17T12:19:54.887 INFO:tasks.workunit:cleanup=True 2026-02-17T12:19:54.888 DEBUG:teuthology.orchestra.run.trial162:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:19:54.953 INFO:tasks.workunit.client.0.trial162.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T12:19:55.234 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: osdmap e25: 3 total, 3 up, 3 in 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: Saving service iscsi.foo spec with placement count:1 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.trial162.gspgco", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-02-17T12:19:55.235 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.trial162.gspgco", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-02-17T12:19:55.236 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:55.236 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: Deploying daemon iscsi.foo.trial162.gspgco on trial162 2026-02-17T12:19:55.236 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:55 trial162 ceph-mon[39588]: pgmap v44: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:19:56.713 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: Checking pool "foo" exists for service iscsi.foo 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/686952302' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2871195227' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/2047647419"}]: dispatch 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.714 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: Adding iSCSI gateway http://:@10.20.193.162:5000 to Dashboard 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "trial162"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "trial162"}]: dispatch 2026-02-17T12:19:56.715 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:56.716 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:19:56.716 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:19:56.716 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:19:56.716 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:56 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:57.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:57 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2871195227' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/2047647419"}]': finished 2026-02-17T12:19:57.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:57 trial162 ceph-mon[39588]: osdmap e26: 3 total, 3 up, 3 in 2026-02-17T12:19:57.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:57 trial162 ceph-mon[39588]: pgmap v46: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:19:57.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:57 trial162 ceph-mon[39588]: from='mgr.14150 10.20.193.162:0/82041336' entity='mgr.a' 2026-02-17T12:19:57.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:57 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2146366513' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6800/1738738496"}]: dispatch 2026-02-17T12:19:58.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:58 trial162 ceph-mon[39588]: mgrmap e15: a(active, since 60s) 2026-02-17T12:19:58.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:58 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2146366513' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6800/1738738496"}]': finished 2026-02-17T12:19:58.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:58 trial162 ceph-mon[39588]: osdmap e27: 3 total, 3 up, 3 in 2026-02-17T12:19:58.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:58 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1807874680' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/2620057420"}]: dispatch 2026-02-17T12:20:00.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:59 trial162 ceph-mon[39588]: pgmap v48: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail; 545 B/s rd, 545 B/s wr, 2 op/s 2026-02-17T12:20:00.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:59 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1807874680' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/2620057420"}]': finished 2026-02-17T12:20:00.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:59 trial162 ceph-mon[39588]: osdmap e28: 3 total, 3 up, 3 in 2026-02-17T12:20:00.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:19:59 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3139871581' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6801/2598679984"}]: dispatch 2026-02-17T12:20:01.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:00 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3139871581' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6801/2598679984"}]': finished 2026-02-17T12:20:01.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:00 trial162 ceph-mon[39588]: osdmap e29: 3 total, 3 up, 3 in 2026-02-17T12:20:01.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:00 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/80941252' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6800/2598679984"}]: dispatch 2026-02-17T12:20:02.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:01 trial162 ceph-mon[39588]: pgmap v51: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail; 745 B/s rd, 745 B/s wr, 3 op/s 2026-02-17T12:20:02.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:01 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/80941252' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6800/2598679984"}]': finished 2026-02-17T12:20:02.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:01 trial162 ceph-mon[39588]: osdmap e30: 3 total, 3 up, 3 in 2026-02-17T12:20:02.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:01 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/587827716' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6801/1738738496"}]: dispatch 2026-02-17T12:20:03.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:02 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/587827716' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:6801/1738738496"}]': finished 2026-02-17T12:20:03.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:02 trial162 ceph-mon[39588]: osdmap e31: 3 total, 3 up, 3 in 2026-02-17T12:20:03.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:02 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1279186503' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/868908951"}]: dispatch 2026-02-17T12:20:04.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:03 trial162 ceph-mon[39588]: pgmap v54: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:20:04.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:03 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1279186503' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/868908951"}]': finished 2026-02-17T12:20:04.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:03 trial162 ceph-mon[39588]: osdmap e32: 3 total, 3 up, 3 in 2026-02-17T12:20:04.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:03 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/460249942' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/797661813"}]: dispatch 2026-02-17T12:20:04.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:03 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/460249942' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/797661813"}]': finished 2026-02-17T12:20:04.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:03 trial162 ceph-mon[39588]: osdmap e33: 3 total, 3 up, 3 in 2026-02-17T12:20:04.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:03 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2720103513' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/3841361353"}]: dispatch 2026-02-17T12:20:05.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:04 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2720103513' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/3841361353"}]': finished 2026-02-17T12:20:05.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:04 trial162 ceph-mon[39588]: osdmap e34: 3 total, 3 up, 3 in 2026-02-17T12:20:05.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:04 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1328806753' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/3040960267"}]: dispatch 2026-02-17T12:20:06.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:05 trial162 ceph-mon[39588]: pgmap v58: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.3 KiB/s rd, 1 op/s 2026-02-17T12:20:06.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:05 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1328806753' entity='client.iscsi.foo.trial162.gspgco' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.162:0/3040960267"}]': finished 2026-02-17T12:20:06.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:05 trial162 ceph-mon[39588]: osdmap e35: 3 total, 3 up, 3 in 2026-02-17T12:20:07.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:06 trial162 ceph-mon[39588]: from='client.14271 -' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T12:20:08.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:07 trial162 ceph-mon[39588]: pgmap v60: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T12:20:10.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:09 trial162 ceph-mon[39588]: pgmap v61: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.7 KiB/s rd, 1 op/s 2026-02-17T12:20:12.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:11 trial162 ceph-mon[39588]: pgmap v62: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.3 KiB/s rd, 1 op/s 2026-02-17T12:20:14.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:13 trial162 ceph-mon[39588]: pgmap v63: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 580 B/s rd, 0 op/s 2026-02-17T12:20:14.534 INFO:tasks.workunit.client.0.trial162.stderr:Note: switching to '3c96dfb3f50b3d02598a82af7104764bfdcd3919'. 2026-02-17T12:20:14.535 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-17T12:20:14.535 INFO:tasks.workunit.client.0.trial162.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T12:20:14.535 INFO:tasks.workunit.client.0.trial162.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T12:20:14.535 INFO:tasks.workunit.client.0.trial162.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T12:20:14.535 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-17T12:20:14.535 INFO:tasks.workunit.client.0.trial162.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T12:20:14.535 INFO:tasks.workunit.client.0.trial162.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr: git switch -c 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr:Or undo this operation with: 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr: git switch - 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-17T12:20:14.536 INFO:tasks.workunit.client.0.trial162.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T12:20:14.537 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-17T12:20:14.537 INFO:tasks.workunit.client.0.trial162.stderr:HEAD is now at 3c96dfb3f50 Merge branch 'wip-ifed-non-spatial-alloc-squi' of https://github.com/ifed01/ceph into wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:20:14.542 DEBUG:teuthology.orchestra.run.trial162:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T12:20:14.600 INFO:tasks.workunit.client.0.trial162.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-17T12:20:14.602 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T12:20:14.602 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-17T12:20:14.701 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-17T12:20:14.733 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-17T12:20:14.758 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T12:20:14.760 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T12:20:14.760 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-17T12:20:14.784 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T12:20:14.788 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-17T12:20:14.788 DEBUG:teuthology.orchestra.run.trial162:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T12:20:14.846 INFO:tasks.workunit:Running workunits matching cephadm/test_iscsi_pids_limit.sh on client.0... 2026-02-17T12:20:14.850 INFO:tasks.workunit:Running workunit cephadm/test_iscsi_pids_limit.sh... 2026-02-17T12:20:14.851 DEBUG:teuthology.orchestra.run.trial162:workunit test cephadm/test_iscsi_pids_limit.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_pids_limit.sh 2026-02-17T12:20:14.906 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman ps -qa --filter=name=iscsi 2026-02-17T12:20:14.934 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_CONT_IDS='e1e2e3389e87 2026-02-17T12:20:14.934 INFO:tasks.workunit.client.0.trial162.stderr:7adb03ded03f' 2026-02-17T12:20:14.934 INFO:tasks.workunit.client.0.trial162.stderr:++ echo e1e2e3389e87 7adb03ded03f 2026-02-17T12:20:14.934 INFO:tasks.workunit.client.0.trial162.stderr:++ wc -w 2026-02-17T12:20:14.935 INFO:tasks.workunit.client.0.trial162.stderr:+ CONT_COUNT=2 2026-02-17T12:20:14.936 INFO:tasks.workunit.client.0.trial162.stderr:+ test 2 -eq 2 2026-02-17T12:20:14.936 INFO:tasks.workunit.client.0.trial162.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T12:20:14.936 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec e1e2e3389e87 cat /sys/fs/cgroup/pids/pids.max 2026-02-17T12:20:14.983 INFO:tasks.workunit.client.0.trial162.stderr:cat: /sys/fs/cgroup/pids/pids.max: No such file or directory 2026-02-17T12:20:14.993 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' ']' 2026-02-17T12:20:14.993 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec e1e2e3389e87 cat /sys/fs/cgroup/pids.max 2026-02-17T12:20:15.040 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' max ']' 2026-02-17T12:20:15.040 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec e1e2e3389e87 cat /sys/fs/cgroup/pids.max 2026-02-17T12:20:15.123 INFO:tasks.workunit.client.0.trial162.stderr:+ pid_limit=max 2026-02-17T12:20:15.123 INFO:tasks.workunit.client.0.trial162.stderr:+ test max == max 2026-02-17T12:20:15.123 INFO:tasks.workunit.client.0.trial162.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T12:20:15.123 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec 7adb03ded03f cat /sys/fs/cgroup/pids/pids.max 2026-02-17T12:20:15.160 INFO:tasks.workunit.client.0.trial162.stderr:cat: /sys/fs/cgroup/pids/pids.max: No such file or directory 2026-02-17T12:20:15.169 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' ']' 2026-02-17T12:20:15.169 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec 7adb03ded03f cat /sys/fs/cgroup/pids.max 2026-02-17T12:20:15.253 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' max ']' 2026-02-17T12:20:15.253 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec 7adb03ded03f cat /sys/fs/cgroup/pids.max 2026-02-17T12:20:15.294 INFO:tasks.workunit.client.0.trial162.stderr:+ pid_limit=max 2026-02-17T12:20:15.294 INFO:tasks.workunit.client.0.trial162.stderr:+ test max == max 2026-02-17T12:20:15.294 INFO:tasks.workunit.client.0.trial162.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T12:20:15.294 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec e1e2e3389e87 /bin/sh -c 'for j in {0..20000}; do sleep 300 & done' 2026-02-17T12:20:16.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:15 trial162 ceph-mon[39588]: pgmap v64: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1023 B/s rd, 0 op/s 2026-02-17T12:20:17.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:16 trial162 ceph-mon[39588]: from='client.14271 -' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T12:20:18.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:17 trial162 ceph-mon[39588]: pgmap v65: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 866 B/s rd, 0 op/s 2026-02-17T12:20:19.255 INFO:tasks.workunit.client.0.trial162.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T12:20:19.255 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec 7adb03ded03f /bin/sh -c 'for j in {0..20000}; do sleep 300 & done' 2026-02-17T12:20:20.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:19 trial162 ceph-mon[39588]: pgmap v66: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T12:20:22.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:21 trial162 ceph-mon[39588]: pgmap v67: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T12:20:23.237 INFO:tasks.workunit.client.0.trial162.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T12:20:23.237 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec e1e2e3389e87 /bin/sh -c 'ps -ef | grep -c sleep' 2026-02-17T12:20:23.852 INFO:tasks.workunit.client.0.trial162.stderr:+ SLEEP_COUNT=20003 2026-02-17T12:20:23.852 INFO:tasks.workunit.client.0.trial162.stderr:+ test 20003 -gt 20000 2026-02-17T12:20:23.852 INFO:tasks.workunit.client.0.trial162.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T12:20:23.852 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman exec 7adb03ded03f /bin/sh -c 'ps -ef | grep -c sleep' 2026-02-17T12:20:24.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:23 trial162 ceph-mon[39588]: pgmap v68: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T12:20:24.468 INFO:tasks.workunit.client.0.trial162.stderr:+ SLEEP_COUNT=20003 2026-02-17T12:20:24.468 INFO:tasks.workunit.client.0.trial162.stderr:+ test 20003 -gt 20000 2026-02-17T12:20:24.469 INFO:tasks.workunit.client.0.trial162.stderr:+ echo OK 2026-02-17T12:20:24.470 INFO:tasks.workunit.client.0.trial162.stdout:OK 2026-02-17T12:20:24.470 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:20:24.470 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:20:24.536 INFO:tasks.workunit:Running workunits matching cephadm/test_iscsi_etc_hosts.sh on client.0... 2026-02-17T12:20:24.539 INFO:tasks.workunit:Running workunit cephadm/test_iscsi_etc_hosts.sh... 2026-02-17T12:20:24.540 DEBUG:teuthology.orchestra.run.trial162:workunit test cephadm/test_iscsi_etc_hosts.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_etc_hosts.sh 2026-02-17T12:20:24.597 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo /home/ubuntu/cephtest/cephadm ls 2026-02-17T12:20:24.597 INFO:tasks.workunit.client.0.trial162.stderr:++ jq -r '.[] | select(.service_name == "iscsi.foo") | .name' 2026-02-17T12:20:25.147 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_DAEMON=iscsi.foo.trial162.gspgco 2026-02-17T12:20:25.147 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo /home/ubuntu/cephtest/cephadm enter --name iscsi.foo.trial162.gspgco -- cat /etc/hosts 2026-02-17T12:20:25.291 INFO:tasks.workunit.client.0.trial162.stderr:Inferring fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:20:25.371 INFO:tasks.workunit.client.0.trial162.stderr:+ cmp --silent /etc/hosts iscsi_daemon_etc_hosts.txt 2026-02-17T12:20:25.371 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'Daemon and host /etc/hosts files successfully matched' 2026-02-17T12:20:25.372 INFO:tasks.workunit.client.0.trial162.stdout:Daemon and host /etc/hosts files successfully matched 2026-02-17T12:20:25.373 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:20:25.373 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:20:25.440 INFO:tasks.workunit:Running workunits matching cephadm/test_iscsi_setup.sh on client.0... 2026-02-17T12:20:25.442 INFO:tasks.workunit:Running workunit cephadm/test_iscsi_setup.sh... 2026-02-17T12:20:25.442 DEBUG:teuthology.orchestra.run.trial162:workunit test cephadm/test_iscsi_setup.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c96dfb3f50b3d02598a82af7104764bfdcd3919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_setup.sh 2026-02-17T12:20:25.501 INFO:tasks.workunit.client.0.trial162.stderr:+ grep -q rhel /etc/centos-release /etc/os-release /etc/redhat-release /etc/system-release 2026-02-17T12:20:25.502 INFO:tasks.workunit.client.0.trial162.stderr:+ command -v cephadm 2026-02-17T12:20:25.503 INFO:tasks.workunit.client.0.trial162.stdout:/usr/sbin/cephadm 2026-02-17T12:20:25.503 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo ls /dev/disk/by-path 2026-02-17T12:20:25.503 INFO:tasks.workunit.client.0.trial162.stderr:+ grep iscsi 2026-02-17T12:20:25.512 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo dnf install jq -y 2026-02-17T12:20:25.808 INFO:tasks.workunit.client.0.trial162.stdout:Last metadata expiration check: 0:03:12 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:20:25.872 INFO:tasks.workunit.client.0.trial162.stdout:Package jq-1.6-19.el9.x86_64 is already installed. 2026-02-17T12:20:25.890 INFO:tasks.workunit.client.0.trial162.stdout:Dependencies resolved. 2026-02-17T12:20:25.890 INFO:tasks.workunit.client.0.trial162.stdout:Nothing to do. 2026-02-17T12:20:25.891 INFO:tasks.workunit.client.0.trial162.stdout:Complete! 2026-02-17T12:20:25.911 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo podman ps -qa --filter=name=iscsi 2026-02-17T12:20:25.911 INFO:tasks.workunit.client.0.trial162.stderr:++ head -n 1 2026-02-17T12:20:25.941 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_CONT_ID=e1e2e3389e87 2026-02-17T12:20:25.941 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo cephadm ls --no-detail 2026-02-17T12:20:25.941 INFO:tasks.workunit.client.0.trial162.stderr:++ jq -r '.[] | select(.name | startswith("iscsi")) | .name' 2026-02-17T12:20:26.103 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_DAEMON_NAME=iscsi.foo.trial162.gspgco 2026-02-17T12:20:26.103 INFO:tasks.workunit.client.0.trial162.stderr:++ cut -d . -f2- 2026-02-17T12:20:26.103 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_DAEMON_ID=foo.trial162.gspgco 2026-02-17T12:20:26.104 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo cephadm shell -- ceph orch ps --daemon-id foo.trial162.gspgco -f json 2026-02-17T12:20:26.104 INFO:tasks.workunit.client.0.trial162.stderr:++ jq -r '.[] | .hostname' 2026-02-17T12:20:26.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:25 trial162 ceph-mon[39588]: pgmap v69: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T12:20:26.245 INFO:tasks.workunit.client.0.trial162.stderr:Inferring fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:20:26.292 INFO:tasks.workunit.client.0.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:20:26.378 INFO:tasks.workunit.client.0.trial162.stderr:Using ceph image with id '61a910d60eeb' and tag '3c96dfb3f50b3d02598a82af7104764bfdcd3919' created on 2026-02-13 11:51:11 +0000 UTC 2026-02-17T12:20:26.378 INFO:tasks.workunit.client.0.trial162.stderr:quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6 2026-02-17T12:20:26.766 INFO:tasks.workunit.client.0.trial162.stderr:+ HOSTNAME=trial162 2026-02-17T12:20:26.767 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo cephadm shell -- ceph orch host ls --format json 2026-02-17T12:20:26.767 INFO:tasks.workunit.client.0.trial162.stderr:++ jq --arg HOSTNAME trial162 -r '.[] | select(.hostname == $HOSTNAME) | .addr' 2026-02-17T12:20:26.911 INFO:tasks.workunit.client.0.trial162.stderr:Inferring fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:20:26.953 INFO:tasks.workunit.client.0.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:20:27.035 INFO:tasks.workunit.client.0.trial162.stderr:Using ceph image with id '61a910d60eeb' and tag '3c96dfb3f50b3d02598a82af7104764bfdcd3919' created on 2026-02-13 11:51:11 +0000 UTC 2026-02-17T12:20:27.035 INFO:tasks.workunit.client.0.trial162.stderr:quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6 2026-02-17T12:20:27.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:26 trial162 ceph-mon[39588]: from='client.14271 -' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T12:20:27.409 INFO:tasks.workunit.client.0.trial162.stderr:+ NODE_IP=10.20.193.162 2026-02-17T12:20:27.409 INFO:tasks.workunit.client.0.trial162.stderr:++ python3 -c 'import socket; print(socket.getfqdn())' 2026-02-17T12:20:27.423 INFO:tasks.workunit.client.0.trial162.stderr:+ FQDN=trial162 2026-02-17T12:20:27.424 INFO:tasks.workunit.client.0.trial162.stderr:++ python3 -c 'import socket; print(socket.getfqdn())' 2026-02-17T12:20:27.440 INFO:tasks.workunit.client.0.trial162.stderr:+ FQDN=trial162 2026-02-17T12:20:27.441 INFO:tasks.workunit.client.0.trial162.stderr:++ sudo cephadm shell -- ceph orch ls iscsi --format json 2026-02-17T12:20:27.441 INFO:tasks.workunit.client.0.trial162.stderr:++ jq -r '.[] | .spec | .pool' 2026-02-17T12:20:27.584 INFO:tasks.workunit.client.0.trial162.stderr:Inferring fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:20:27.629 INFO:tasks.workunit.client.0.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:20:27.712 INFO:tasks.workunit.client.0.trial162.stderr:Using ceph image with id '61a910d60eeb' and tag '3c96dfb3f50b3d02598a82af7104764bfdcd3919' created on 2026-02-13 11:51:11 +0000 UTC 2026-02-17T12:20:27.712 INFO:tasks.workunit.client.0.trial162.stderr:quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6 2026-02-17T12:20:28.066 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:27 trial162 ceph-mon[39588]: from='client.14296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_id": "foo.trial162.gspgco", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:20:28.066 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:27 trial162 ceph-mon[39588]: pgmap v70: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T12:20:28.092 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_POOL=foo 2026-02-17T12:20:28.092 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_USER=adminadmin 2026-02-17T12:20:28.092 INFO:tasks.workunit.client.0.trial162.stderr:+ ISCSI_PASSWORD=adminadminadmin 2026-02-17T12:20:28.092 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /iscsi-targets create iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw 2026-02-17T12:20:28.092 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /iscsi-targets create iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw 2026-02-17T12:20:28.593 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/gateways create trial162 10.20.193.162 2026-02-17T12:20:28.593 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/gateways create trial162 10.20.193.162 2026-02-17T12:20:29.054 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /disks create pool=foo image=disk_1 size=2G 2026-02-17T12:20:29.054 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /disks create pool=foo image=disk_1 size=2G 2026-02-17T12:20:29.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.14300 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "iscsi", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3014116445' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/581815194' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2219728575' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2696318799' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4083703742' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2383541576' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1606616110' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:29.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:28 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4226768625' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:29.602 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /disks create pool=foo image=disk_2 size=2G 2026-02-17T12:20:29.602 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /disks create pool=foo image=disk_2 size=2G 2026-02-17T12:20:30.126 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts create iqn.1994-05.com.redhat:client1 2026-02-17T12:20:30.126 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts create iqn.1994-05.com.redhat:client1 2026-02-17T12:20:30.172 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: pgmap v71: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3347765057' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/785160190' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1025154835' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4044916725' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2136847692' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/272390889' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/758483858' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/840637236' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/840637236' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/840637236' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3603407527' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/949038649' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4148473838' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:30.173 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:29 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/82851477' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:30.594 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 auth username=adminadmin password=adminadminadmin 2026-02-17T12:20:30.594 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 auth username=adminadmin password=adminadminadmin 2026-02-17T12:20:31.055 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_1 2026-02-17T12:20:31.055 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_1 2026-02-17T12:20:31.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2975629205' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2228133208' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1821875279' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1821875279' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1821875279' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1821875279' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist","blocklistop": "rm","addr": "10.20.193.162:0/840637236"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/39302370' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1448189148' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1628263306' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/368783121' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:31.214 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3239962696' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:31.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/784128209' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:31.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2324272243' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:31.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3226558651' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:31.215 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:30 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2856382037' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:31.633 INFO:tasks.workunit.client.0.trial162.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_2 2026-02-17T12:20:31.633 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo podman exec -it e1e2e3389e87 gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_2 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: pgmap v72: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/536472984' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/199737359' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2478343525' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3091813559' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2077057569' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3071654551' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:32.177 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/4044888336' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:32.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/788872696' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T12:20:32.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/788872696' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T12:20:32.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/788872696' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T12:20:32.178 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:31 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/788872696' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd blocklist","blocklistop": "rm","addr": "10.20.193.162:0/1821875279"}]: dispatch 2026-02-17T12:20:32.213 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo dnf install -y iscsi-initiator-utils device-mapper-multipath 2026-02-17T12:20:32.514 INFO:tasks.workunit.client.0.trial162.stdout:Last metadata expiration check: 0:03:19 ago on Tue 17 Feb 2026 12:17:13 PM UTC. 2026-02-17T12:20:32.580 INFO:tasks.workunit.client.0.trial162.stdout:Package iscsi-initiator-utils-6.2.1.11-0.git4b3e853.el9.x86_64 is already installed. 2026-02-17T12:20:32.599 INFO:tasks.workunit.client.0.trial162.stdout:Dependencies resolved. 2026-02-17T12:20:32.600 INFO:tasks.workunit.client.0.trial162.stdout:================================================================================ 2026-02-17T12:20:32.600 INFO:tasks.workunit.client.0.trial162.stdout: Package Arch Version Repository Size 2026-02-17T12:20:32.600 INFO:tasks.workunit.client.0.trial162.stdout:================================================================================ 2026-02-17T12:20:32.600 INFO:tasks.workunit.client.0.trial162.stdout:Installing: 2026-02-17T12:20:32.600 INFO:tasks.workunit.client.0.trial162.stdout: device-mapper-multipath x86_64 0.8.7-44.el9 baseos 156 k 2026-02-17T12:20:32.600 INFO:tasks.workunit.client.0.trial162.stdout:Upgrading: 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout: device-mapper-multipath-libs x86_64 0.8.7-44.el9 baseos 287 k 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout: kpartx x86_64 0.8.7-44.el9 baseos 49 k 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout: 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout:Transaction Summary 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout:================================================================================ 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout:Install 1 Package 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout:Upgrade 2 Packages 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout: 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout:Total download size: 492 k 2026-02-17T12:20:32.601 INFO:tasks.workunit.client.0.trial162.stdout:Downloading Packages: 2026-02-17T12:20:32.759 INFO:tasks.workunit.client.0.trial162.stdout:(1/3): kpartx-0.8.7-44.el9.x86_64.rpm 496 kB/s | 49 kB 00:00 2026-02-17T12:20:32.780 INFO:tasks.workunit.client.0.trial162.stdout:(2/3): device-mapper-multipath-0.8.7-44.el9.x86 1.3 MB/s | 156 kB 00:00 2026-02-17T12:20:32.781 INFO:tasks.workunit.client.0.trial162.stdout:(3/3): device-mapper-multipath-libs-0.8.7-44.el 2.3 MB/s | 287 kB 00:00 2026-02-17T12:20:32.782 INFO:tasks.workunit.client.0.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:20:32.782 INFO:tasks.workunit.client.0.trial162.stdout:Total 2.6 MB/s | 492 kB 00:00 2026-02-17T12:20:32.809 INFO:tasks.workunit.client.0.trial162.stdout:Running transaction check 2026-02-17T12:20:32.815 INFO:tasks.workunit.client.0.trial162.stdout:Transaction check succeeded. 2026-02-17T12:20:32.816 INFO:tasks.workunit.client.0.trial162.stdout:Running transaction test 2026-02-17T12:20:32.856 INFO:tasks.workunit.client.0.trial162.stdout:Transaction test succeeded. 2026-02-17T12:20:32.856 INFO:tasks.workunit.client.0.trial162.stdout:Running transaction 2026-02-17T12:20:32.916 INFO:tasks.workunit.client.0.trial162.stdout: Preparing : 1/1 2026-02-17T12:20:32.930 INFO:tasks.workunit.client.0.trial162.stdout: Upgrading : kpartx-0.8.7-44.el9.x86_64 1/5 2026-02-17T12:20:32.937 INFO:tasks.workunit.client.0.trial162.stdout: Upgrading : device-mapper-multipath-libs-0.8.7-44.el9.x86_64 2/5 2026-02-17T12:20:32.939 INFO:tasks.workunit.client.0.trial162.stdout: Installing : device-mapper-multipath-0.8.7-44.el9.x86_64 3/5 2026-02-17T12:20:32.956 INFO:tasks.workunit.client.0.trial162.stdout: Running scriptlet: device-mapper-multipath-0.8.7-44.el9.x86_64 3/5 2026-02-17T12:20:32.956 INFO:tasks.workunit.client.0.trial162.stdout:Created symlink /etc/systemd/system/sysinit.target.wants/multipathd.service → /usr/lib/systemd/system/multipathd.service. 2026-02-17T12:20:32.956 INFO:tasks.workunit.client.0.trial162.stdout:Created symlink /etc/systemd/system/sockets.target.wants/multipathd.socket → /usr/lib/systemd/system/multipathd.socket. 2026-02-17T12:20:32.956 INFO:tasks.workunit.client.0.trial162.stdout: 2026-02-17T12:20:32.959 INFO:tasks.workunit.client.0.trial162.stdout: Cleanup : kpartx-0.8.7-39.el9.x86_64 4/5 2026-02-17T12:20:32.979 INFO:tasks.workunit.client.0.trial162.stdout: Cleanup : device-mapper-multipath-libs-0.8.7-39.el9.x86_64 5/5 2026-02-17T12:20:33.029 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3456810664' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T12:20:33.029 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/17024818' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:20:33.029 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/1644588187' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:33.029 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/3092891' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T12:20:33.029 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/2255485020' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T12:20:33.029 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/655852249' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T12:20:33.030 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/655852249' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T12:20:33.030 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:32 trial162 ceph-mon[39588]: from='client.? 10.20.193.162:0/655852249' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T12:20:33.468 INFO:tasks.workunit.client.0.trial162.stdout: Running scriptlet: device-mapper-multipath-libs-0.8.7-39.el9.x86_64 5/5 2026-02-17T12:20:33.468 INFO:tasks.workunit.client.0.trial162.stdout: Verifying : device-mapper-multipath-0.8.7-44.el9.x86_64 1/5 2026-02-17T12:20:33.468 INFO:tasks.workunit.client.0.trial162.stdout: Verifying : device-mapper-multipath-libs-0.8.7-44.el9.x86_64 2/5 2026-02-17T12:20:33.468 INFO:tasks.workunit.client.0.trial162.stdout: Verifying : device-mapper-multipath-libs-0.8.7-39.el9.x86_64 3/5 2026-02-17T12:20:33.468 INFO:tasks.workunit.client.0.trial162.stdout: Verifying : kpartx-0.8.7-44.el9.x86_64 4/5 2026-02-17T12:20:33.525 INFO:tasks.workunit.client.0.trial162.stdout: Verifying : kpartx-0.8.7-39.el9.x86_64 5/5 2026-02-17T12:20:33.525 INFO:tasks.workunit.client.0.trial162.stdout: 2026-02-17T12:20:33.525 INFO:tasks.workunit.client.0.trial162.stdout:Upgraded: 2026-02-17T12:20:33.525 INFO:tasks.workunit.client.0.trial162.stdout: device-mapper-multipath-libs-0.8.7-44.el9.x86_64 kpartx-0.8.7-44.el9.x86_64 2026-02-17T12:20:33.525 INFO:tasks.workunit.client.0.trial162.stdout:Installed: 2026-02-17T12:20:33.525 INFO:tasks.workunit.client.0.trial162.stdout: device-mapper-multipath-0.8.7-44.el9.x86_64 2026-02-17T12:20:33.526 INFO:tasks.workunit.client.0.trial162.stdout: 2026-02-17T12:20:33.526 INFO:tasks.workunit.client.0.trial162.stdout:Complete! 2026-02-17T12:20:33.555 INFO:tasks.workunit.client.0.trial162.stderr:+ echo GenerateName=no 2026-02-17T12:20:33.555 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo tee /etc/iscsi/initiatorname.iscsi 2026-02-17T12:20:33.565 INFO:tasks.workunit.client.0.trial162.stdout:GenerateName=no 2026-02-17T12:20:33.566 INFO:tasks.workunit.client.0.trial162.stderr:+ echo InitiatorName=iqn.1994-05.com.redhat:client1 2026-02-17T12:20:33.566 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo tee -a /etc/iscsi/initiatorname.iscsi 2026-02-17T12:20:33.573 INFO:tasks.workunit.client.0.trial162.stdout:InitiatorName=iqn.1994-05.com.redhat:client1 2026-02-17T12:20:33.574 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'node.session.auth.authmethod = CHAP' 2026-02-17T12:20:33.574 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo tee -a /etc/iscsi/iscsid.conf 2026-02-17T12:20:33.583 INFO:tasks.workunit.client.0.trial162.stdout:node.session.auth.authmethod = CHAP 2026-02-17T12:20:33.584 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'node.session.auth.username = adminadmin' 2026-02-17T12:20:33.584 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo tee -a /etc/iscsi/iscsid.conf 2026-02-17T12:20:33.591 INFO:tasks.workunit.client.0.trial162.stdout:node.session.auth.username = adminadmin 2026-02-17T12:20:33.592 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'node.session.auth.password = adminadminadmin' 2026-02-17T12:20:33.592 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo tee -a /etc/iscsi/iscsid.conf 2026-02-17T12:20:33.599 INFO:tasks.workunit.client.0.trial162.stdout:node.session.auth.password = adminadminadmin 2026-02-17T12:20:33.600 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo tee -a /etc/multipath.conf 2026-02-17T12:20:33.610 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo systemctl restart multipathd 2026-02-17T12:20:33.717 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo systemctl restart iscsid 2026-02-17T12:20:33.770 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo iscsiadm -m discovery -t st -p 10.20.193.162 2026-02-17T12:20:33.797 INFO:tasks.workunit.client.0.trial162.stdout:10.20.193.162:3260,1 iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw 2026-02-17T12:20:33.798 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo iscsiadm -m node -T iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw -l 2026-02-17T12:20:33.873 INFO:tasks.workunit.client.0.trial162.stdout:Login to [iface: default, target: iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw, portal: 10.20.193.162,3260] successful. 2026-02-17T12:20:33.884 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo iscsiadm -m session --rescan 2026-02-17T12:20:33.918 INFO:tasks.workunit.client.0.trial162.stdout:Rescanning session [sid: 1, target: iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw, portal: 10.20.193.162,3260] 2026-02-17T12:20:33.921 INFO:tasks.workunit.client.0.trial162.stderr:+ sleep 5 2026-02-17T12:20:34.085 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:33 trial162 ceph-mon[39588]: pgmap v73: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.1 KiB/s rd, 170 B/s wr, 1 op/s 2026-02-17T12:20:36.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:35 trial162 ceph-mon[39588]: pgmap v74: 33 pgs: 33 active+clean; 580 KiB data, 86 MiB used, 2.1 TiB / 2.1 TiB avail; 70 KiB/s rd, 3.4 KiB/s wr, 79 op/s 2026-02-17T12:20:37.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:36 trial162 ceph-mon[39588]: from='client.14271 -' entity='client.iscsi.foo.trial162.gspgco' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T12:20:38.213 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:37 trial162 ceph-mon[39588]: pgmap v75: 33 pgs: 33 active+clean; 580 KiB data, 86 MiB used, 2.1 TiB / 2.1 TiB avail; 70 KiB/s rd, 3.4 KiB/s wr, 78 op/s 2026-02-17T12:20:38.924 INFO:tasks.workunit.client.0.trial162.stderr:+ sudo ls /dev/disk/by-path 2026-02-17T12:20:38.925 INFO:tasks.workunit.client.0.trial162.stderr:+ grep iscsi 2026-02-17T12:20:38.937 INFO:tasks.workunit.client.0.trial162.stdout:ip-10.20.193.162:3260-iscsi-iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw-lun-0 2026-02-17T12:20:38.937 INFO:tasks.workunit.client.0.trial162.stdout:ip-10.20.193.162:3260-iscsi-iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw-lun-1 2026-02-17T12:20:38.937 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T12:20:38.938 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T12:20:39.002 INFO:tasks.workunit:Stopping ['cephadm/test_iscsi_pids_limit.sh', 'cephadm/test_iscsi_etc_hosts.sh', 'cephadm/test_iscsi_setup.sh'] on client.0... 2026-02-17T12:20:39.002 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T12:20:39.338 DEBUG:teuthology.parallel:result is None 2026-02-17T12:20:39.339 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T12:20:39.363 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T12:20:39.364 DEBUG:teuthology.orchestra.run.trial162:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T12:20:39.420 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T12:20:39.420 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-17T12:20:39.430 INFO:tasks.cephadm:Teardown begin 2026-02-17T12:20:39.431 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:20:39.485 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-17T12:20:39.485 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-17T12:20:39.691 INFO:teuthology.orchestra.run.trial162.stderr:Inferring config /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/mon.a/config 2026-02-17T12:20:39.710 INFO:teuthology.orchestra.run.trial162.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-17T12:20:39.733 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-17T12:20:39.733 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-17T12:20:39.734 DEBUG:teuthology.orchestra.run.trial162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-17T12:20:39.752 INFO:tasks.cephadm:Stopping all daemons... 2026-02-17T12:20:39.752 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-17T12:20:39.752 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a 2026-02-17T12:20:39.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:39 trial162 systemd[1]: Stopping Ceph mon.a for c0fec2e3-0bfa-11f1-8517-d404e6e7d460... 2026-02-17T12:20:39.963 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a[39562]: 2026-02-17T12:20:39.906+0000 7fcd421f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T12:20:39.964 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:39 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a[39562]: 2026-02-17T12:20:39.906+0000 7fcd421f8640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T12:20:40.370 DEBUG:teuthology.orchestra.run.trial162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service' 2026-02-17T12:20:40.463 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:40 trial162 podman[117744]: 2026-02-17 12:20:40.15527383 +0000 UTC m=+0.263523977 container died 5ee8407c25a260674b94c2b954087f9e241f72c9e9357a869cfcd08da48c823b (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-17T12:20:40.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:40 trial162 podman[117744]: 2026-02-17 12:20:40.271998806 +0000 UTC m=+0.380248963 container remove 5ee8407c25a260674b94c2b954087f9e241f72c9e9357a869cfcd08da48c823b (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.41.3, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-02-17T12:20:40.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:40 trial162 bash[117744]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mon-a 2026-02-17T12:20:40.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:40 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-17T12:20:40.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:40 trial162 systemd[1]: Stopped Ceph mon.a for c0fec2e3-0bfa-11f1-8517-d404e6e7d460. 2026-02-17T12:20:40.464 INFO:journalctl@ceph.mon.a.trial162.stdout:Feb 17 12:20:40 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mon.a.service: Consumed 2.502s CPU time. 2026-02-17T12:20:41.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T12:20:41.316 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-17T12:20:41.316 INFO:tasks.cephadm.mgr.a:Stopping mgr.a... 2026-02-17T12:20:41.317 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a 2026-02-17T12:20:41.592 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 systemd[1]: Stopping Ceph mgr.a for c0fec2e3-0bfa-11f1-8517-d404e6e7d460... 2026-02-17T12:20:41.592 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a[39871]: 2026-02-17T12:20:41.433+0000 7f4c07075640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T12:20:41.592 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 podman[117912]: 2026-02-17 12:20:41.478912034 +0000 UTC m=+0.059467135 container died aef6cd9119fa2e42a65b899f0447ca1a9bfd71f79e2f634139862bf150dd5118 (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a, ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-02-17T12:20:41.686 DEBUG:teuthology.orchestra.run.trial162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a.service' 2026-02-17T12:20:41.963 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 podman[117912]: 2026-02-17 12:20:41.599833233 +0000 UTC m=+0.180388344 container remove aef6cd9119fa2e42a65b899f0447ca1a9bfd71f79e2f634139862bf150dd5118 (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a, ceph=True, org.label-schema.license=GPLv2, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.build-date=20260209, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T12:20:41.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 bash[117912]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-mgr-a 2026-02-17T12:20:41.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a.service: Deactivated successfully. 2026-02-17T12:20:41.964 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 systemd[1]: Stopped Ceph mgr.a for c0fec2e3-0bfa-11f1-8517-d404e6e7d460. 2026-02-17T12:20:41.965 INFO:journalctl@ceph.mgr.a.trial162.stdout:Feb 17 12:20:41 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@mgr.a.service: Consumed 12.479s CPU time. 2026-02-17T12:20:42.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T12:20:42.496 INFO:tasks.cephadm.mgr.a:Stopped mgr.a 2026-02-17T12:20:42.497 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-17T12:20:42.497 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.0 2026-02-17T12:20:42.964 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:42 trial162 systemd[1]: Stopping Ceph osd.0 for c0fec2e3-0bfa-11f1-8517-d404e6e7d460... 2026-02-17T12:20:42.964 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:42 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0[52627]: 2026-02-17T12:20:42.604+0000 7fbcd64b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T12:20:42.964 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:42 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0[52627]: 2026-02-17T12:20:42.604+0000 7fbcd64b0640 -1 osd.0 35 *** Got signal Terminated *** 2026-02-17T12:20:42.964 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:42 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0[52627]: 2026-02-17T12:20:42.604+0000 7fbcd64b0640 -1 osd.0 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T12:20:48.251 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:47 trial162 podman[118080]: 2026-02-17 12:20:47.972325657 +0000 UTC m=+5.382623145 container died 090f8de4681c5af205a389a52352d1f770db94e0d1c989790cde4bc604552271 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, io.buildah.version=1.41.3, org.label-schema.build-date=20260209, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2) 2026-02-17T12:20:48.251 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118080]: 2026-02-17 12:20:48.091123551 +0000 UTC m=+5.501421039 container remove 090f8de4681c5af205a389a52352d1f770db94e0d1c989790cde4bc604552271 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, ceph=True, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.41.3) 2026-02-17T12:20:48.251 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 bash[118080]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0 2026-02-17T12:20:48.549 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118233]: 2026-02-17 12:20:48.251194691 +0000 UTC m=+0.017166201 container create 3014d88fcb4c4ecfa8b796354dfe2ff5e15db74193afd45980ed2addd7beb735 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, OSD_FLAVOR=default, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260209) 2026-02-17T12:20:48.550 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118233]: 2026-02-17 12:20:48.310733397 +0000 UTC m=+0.076704907 container init 3014d88fcb4c4ecfa8b796354dfe2ff5e15db74193afd45980ed2addd7beb735 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0-deactivate, OSD_FLAVOR=default, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260209, org.label-schema.license=GPLv2) 2026-02-17T12:20:48.550 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118233]: 2026-02-17 12:20:48.318548836 +0000 UTC m=+0.084520356 container start 3014d88fcb4c4ecfa8b796354dfe2ff5e15db74193afd45980ed2addd7beb735 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260209, OSD_FLAVOR=default, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, ceph=True, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid) 2026-02-17T12:20:48.550 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118233]: 2026-02-17 12:20:48.319019801 +0000 UTC m=+0.084991311 container attach 3014d88fcb4c4ecfa8b796354dfe2ff5e15db74193afd45980ed2addd7beb735 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, org.label-schema.license=GPLv2, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, ceph=True, org.label-schema.schema-version=1.0, OSD_FLAVOR=default) 2026-02-17T12:20:48.550 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118233]: 2026-02-17 12:20:48.243613617 +0000 UTC m=+0.009585137 image pull 61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6 2026-02-17T12:20:48.550 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118233]: 2026-02-17 12:20:48.431754402 +0000 UTC m=+0.197725922 container died 3014d88fcb4c4ecfa8b796354dfe2ff5e15db74193afd45980ed2addd7beb735 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default) 2026-02-17T12:20:48.577 DEBUG:teuthology.orchestra.run.trial162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.0.service' 2026-02-17T12:20:48.963 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 podman[118233]: 2026-02-17 12:20:48.552263135 +0000 UTC m=+0.318234655 container remove 3014d88fcb4c4ecfa8b796354dfe2ff5e15db74193afd45980ed2addd7beb735 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-0-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=default, org.label-schema.build-date=20260209, org.label-schema.license=GPLv2, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-17T12:20:48.964 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.0.service: Deactivated successfully. 2026-02-17T12:20:48.964 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 systemd[1]: Stopped Ceph osd.0 for c0fec2e3-0bfa-11f1-8517-d404e6e7d460. 2026-02-17T12:20:48.964 INFO:journalctl@ceph.osd.0.trial162.stdout:Feb 17 12:20:48 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.0.service: Consumed 2.348s CPU time. 2026-02-17T12:20:49.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T12:20:49.389 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-17T12:20:49.389 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-17T12:20:49.389 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.1 2026-02-17T12:20:49.713 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:49 trial162 systemd[1]: Stopping Ceph osd.1 for c0fec2e3-0bfa-11f1-8517-d404e6e7d460... 2026-02-17T12:20:49.714 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1[58207]: 2026-02-17T12:20:49.499+0000 7f8a51ce3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T12:20:49.714 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1[58207]: 2026-02-17T12:20:49.499+0000 7f8a51ce3640 -1 osd.1 35 *** Got signal Terminated *** 2026-02-17T12:20:49.714 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:49 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1[58207]: 2026-02-17T12:20:49.499+0000 7f8a51ce3640 -1 osd.1 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T12:20:55.167 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:54 trial162 podman[118396]: 2026-02-17 12:20:54.876721537 +0000 UTC m=+5.391594283 container died 59ce6e0337a785693ee23e44fbecc01aeb056ad65276faa460ee51b15900aa29 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1, org.label-schema.license=GPLv2, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260209, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, OSD_FLAVOR=default) 2026-02-17T12:20:55.167 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:54 trial162 podman[118396]: 2026-02-17 12:20:54.989281253 +0000 UTC m=+5.504153989 container remove 59ce6e0337a785693ee23e44fbecc01aeb056ad65276faa460ee51b15900aa29 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, org.label-schema.license=GPLv2, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T12:20:55.167 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:54 trial162 bash[118396]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1 2026-02-17T12:20:55.464 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 podman[118539]: 2026-02-17 12:20:55.166868452 +0000 UTC m=+0.016904855 container create 9079838ece8b2ab073bbdbd5961e03ddbb0df65bb13f3639a6e2a610506b1f58 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.build-date=20260209, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T12:20:55.464 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 podman[118539]: 2026-02-17 12:20:55.216366917 +0000 UTC m=+0.066403280 container init 9079838ece8b2ab073bbdbd5961e03ddbb0df65bb13f3639a6e2a610506b1f58 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260209, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, io.buildah.version=1.41.3, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.vendor=CentOS) 2026-02-17T12:20:55.464 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 podman[118539]: 2026-02-17 12:20:55.223422635 +0000 UTC m=+0.073458988 container start 9079838ece8b2ab073bbdbd5961e03ddbb0df65bb13f3639a6e2a610506b1f58 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.build-date=20260209, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-17T12:20:55.464 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 podman[118539]: 2026-02-17 12:20:55.22390963 +0000 UTC m=+0.073945983 container attach 9079838ece8b2ab073bbdbd5961e03ddbb0df65bb13f3639a6e2a610506b1f58 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.41.3, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260209, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919) 2026-02-17T12:20:55.464 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 podman[118539]: 2026-02-17 12:20:55.160040387 +0000 UTC m=+0.010076760 image pull 61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6 2026-02-17T12:20:55.464 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 podman[118539]: 2026-02-17 12:20:55.352465842 +0000 UTC m=+0.202502205 container died 9079838ece8b2ab073bbdbd5961e03ddbb0df65bb13f3639a6e2a610506b1f58 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1-deactivate, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260209, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T12:20:55.503 DEBUG:teuthology.orchestra.run.trial162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.1.service' 2026-02-17T12:20:55.963 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 podman[118539]: 2026-02-17 12:20:55.472600863 +0000 UTC m=+0.322637226 container remove 9079838ece8b2ab073bbdbd5961e03ddbb0df65bb13f3639a6e2a610506b1f58 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-1-deactivate, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.build-date=20260209, OSD_FLAVOR=default, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T12:20:55.964 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.1.service: Deactivated successfully. 2026-02-17T12:20:55.964 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 systemd[1]: Stopped Ceph osd.1 for c0fec2e3-0bfa-11f1-8517-d404e6e7d460. 2026-02-17T12:20:55.964 INFO:journalctl@ceph.osd.1.trial162.stdout:Feb 17 12:20:55 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.1.service: Consumed 2.110s CPU time. 2026-02-17T12:20:56.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T12:20:56.314 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-17T12:20:56.315 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-17T12:20:56.315 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.2 2026-02-17T12:20:56.713 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:20:56 trial162 systemd[1]: Stopping Ceph osd.2 for c0fec2e3-0bfa-11f1-8517-d404e6e7d460... 2026-02-17T12:20:56.713 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:20:56 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2[63782]: 2026-02-17T12:20:56.419+0000 7fade093d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T12:20:56.713 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:20:56 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2[63782]: 2026-02-17T12:20:56.419+0000 7fade093d640 -1 osd.2 35 *** Got signal Terminated *** 2026-02-17T12:20:56.713 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:20:56 trial162 ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2[63782]: 2026-02-17T12:20:56.419+0000 7fade093d640 -1 osd.2 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T12:21:02.034 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:01 trial162 podman[118703]: 2026-02-17 12:21:01.745437603 +0000 UTC m=+5.339764857 container died 8ff1d2ec98d0991c745028891adc2a72735400e202e2b516b8382f09ca321d32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, io.buildah.version=1.41.3, org.label-schema.license=GPLv2) 2026-02-17T12:21:02.034 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:01 trial162 podman[118703]: 2026-02-17 12:21:01.863559449 +0000 UTC m=+5.457886703 container remove 8ff1d2ec98d0991c745028891adc2a72735400e202e2b516b8382f09ca321d32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2, ceph=True, org.label-schema.build-date=20260209, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919) 2026-02-17T12:21:02.034 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:01 trial162 bash[118703]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2 2026-02-17T12:21:02.330 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 podman[118849]: 2026-02-17 12:21:02.033001205 +0000 UTC m=+0.015675562 container create 3af0fd0c4660d29bcc282ba50784940afd0f2aafbe4ab6cee9394d73491baa32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2-deactivate, ceph=True, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-17T12:21:02.331 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 podman[118849]: 2026-02-17 12:21:02.085348191 +0000 UTC m=+0.068022548 container init 3af0fd0c4660d29bcc282ba50784940afd0f2aafbe4ab6cee9394d73491baa32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2-deactivate, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T12:21:02.331 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 podman[118849]: 2026-02-17 12:21:02.092396164 +0000 UTC m=+0.075070511 container start 3af0fd0c4660d29bcc282ba50784940afd0f2aafbe4ab6cee9394d73491baa32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.build-date=20260209, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, io.buildah.version=1.41.3, OSD_FLAVOR=default) 2026-02-17T12:21:02.331 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 podman[118849]: 2026-02-17 12:21:02.092818409 +0000 UTC m=+0.075492776 container attach 3af0fd0c4660d29bcc282ba50784940afd0f2aafbe4ab6cee9394d73491baa32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, io.buildah.version=1.41.3, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-17T12:21:02.331 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 podman[118849]: 2026-02-17 12:21:02.026678128 +0000 UTC m=+0.009352475 image pull 61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6 2026-02-17T12:21:02.331 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 podman[118900]: 2026-02-17 12:21:02.220073142 +0000 UTC m=+0.010952287 container died 3af0fd0c4660d29bcc282ba50784940afd0f2aafbe4ab6cee9394d73491baa32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-17T12:21:02.365 DEBUG:teuthology.orchestra.run.trial162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.2.service' 2026-02-17T12:21:02.713 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 podman[118900]: 2026-02-17 12:21:02.333793373 +0000 UTC m=+0.124672508 container remove 3af0fd0c4660d29bcc282ba50784940afd0f2aafbe4ab6cee9394d73491baa32 (image=quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6, name=ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, ceph=True, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T12:21:02.714 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.2.service: Deactivated successfully. 2026-02-17T12:21:02.714 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 systemd[1]: Stopped Ceph osd.2 for c0fec2e3-0bfa-11f1-8517-d404e6e7d460. 2026-02-17T12:21:02.714 INFO:journalctl@ceph.osd.2.trial162.stdout:Feb 17 12:21:02 trial162 systemd[1]: ceph-c0fec2e3-0bfa-11f1-8517-d404e6e7d460@osd.2.service: Consumed 2.097s CPU time. 2026-02-17T12:21:03.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T12:21:03.179 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-17T12:21:03.179 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 --force --keep-logs 2026-02-17T12:21:03.302 INFO:teuthology.orchestra.run.trial162.stdout:Deleting cluster with fsid: c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:21:15.858 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:21:15.885 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-17T12:21:15.887 DEBUG:teuthology.misc:Transferring archived files from trial162:/var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51426/remote/trial162/crash 2026-02-17T12:21:15.888 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/crash -- . 2026-02-17T12:21:15.951 INFO:teuthology.orchestra.run.trial162.stderr:tar: /var/lib/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-17T12:21:15.952 INFO:teuthology.orchestra.run.trial162.stderr:tar: Error is not recoverable: exiting now 2026-02-17T12:21:15.953 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-17T12:21:15.953 DEBUG:teuthology.orchestra.run.trial162:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v CEPHADM_FAILED_DAEMON | head -n 1 2026-02-17T12:21:16.021 INFO:tasks.cephadm:Compressing logs... 2026-02-17T12:21:16.022 DEBUG:teuthology.orchestra.run.trial162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:21:16.087 INFO:teuthology.orchestra.run.trial162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-17T12:21:16.087 INFO:teuthology.orchestra.run.trial162.stderr:: No such file or directory 2026-02-17T12:21:16.087 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.2.log 2026-02-17T12:21:16.087 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-mon.a.log 2026-02-17T12:21:16.087 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.0.log 2026-02-17T12:21:16.087 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.2.log: /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.cephadm.log 2026-02-17T12:21:16.087 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-mgr.a.log 2026-02-17T12:21:16.088 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.0.log: /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.cephadm.log: 90.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-17T12:21:16.088 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.audit.log 2026-02-17T12:21:16.088 INFO:teuthology.orchestra.run.trial162.stderr: 76.2% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.cephadm.log.gz 2026-02-17T12:21:16.088 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-volume.log 2026-02-17T12:21:16.088 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-mgr.a.log: /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.1.log 2026-02-17T12:21:16.088 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/tcmu-runner.log 2026-02-17T12:21:16.089 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.1.log: 89.2% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.audit.log.gz 2026-02-17T12:21:16.089 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.log 2026-02-17T12:21:16.089 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/tcmu-runner.log: 75.3% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/tcmu-runner.log.gz 2026-02-17T12:21:16.089 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.log: 82.6% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph.log.gz 2026-02-17T12:21:16.091 INFO:teuthology.orchestra.run.trial162.stderr: 95.5% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-volume.log.gz 2026-02-17T12:21:16.108 INFO:teuthology.orchestra.run.trial162.stderr: 89.9% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-mgr.a.log.gz 2026-02-17T12:21:16.133 INFO:teuthology.orchestra.run.trial162.stderr: 94.4% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.0.log.gz 2026-02-17T12:21:16.139 INFO:teuthology.orchestra.run.trial162.stderr: 91.9% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-mon.a.log.gz 2026-02-17T12:21:16.140 INFO:teuthology.orchestra.run.trial162.stderr: 94.5% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.1.log.gz 2026-02-17T12:21:16.166 INFO:teuthology.orchestra.run.trial162.stderr: 94.9% -- replaced with /var/log/ceph/c0fec2e3-0bfa-11f1-8517-d404e6e7d460/ceph-osd.2.log.gz 2026-02-17T12:21:16.168 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-17T12:21:16.168 INFO:teuthology.orchestra.run.trial162.stderr:real 0m0.091s 2026-02-17T12:21:16.168 INFO:teuthology.orchestra.run.trial162.stderr:user 0m0.251s 2026-02-17T12:21:16.168 INFO:teuthology.orchestra.run.trial162.stderr:sys 0m0.036s 2026-02-17T12:21:16.169 INFO:tasks.cephadm:Archiving logs... 2026-02-17T12:21:16.169 DEBUG:teuthology.misc:Transferring archived files from trial162:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51426/remote/trial162/log 2026-02-17T12:21:16.170 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:21:16.311 INFO:tasks.cephadm:Removing cluster... 2026-02-17T12:21:16.311 DEBUG:teuthology.orchestra.run.trial162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c0fec2e3-0bfa-11f1-8517-d404e6e7d460 --force 2026-02-17T12:21:16.442 INFO:teuthology.orchestra.run.trial162.stdout:Deleting cluster with fsid: c0fec2e3-0bfa-11f1-8517-d404e6e7d460 2026-02-17T12:21:16.635 INFO:tasks.cephadm:Removing cephadm ... 2026-02-17T12:21:16.635 DEBUG:teuthology.orchestra.run.trial162:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T12:21:16.651 INFO:tasks.cephadm:Teardown complete 2026-02-17T12:21:16.651 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T12:21:16.665 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T12:21:16.665 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:21:16.817 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T12:21:16.828 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T12:21:16.828 DEBUG:teuthology.orchestra.run.trial162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:21:16.844 INFO:teuthology.orchestra.run.trial162.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:21:16.859 INFO:teuthology.orchestra.run.trial162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:21:16.860 INFO:teuthology.orchestra.run.trial162.stdout:=============================================================================== 2026-02-17T12:21:16.860 INFO:teuthology.orchestra.run.trial162.stdout:^* 107-172-222-7-host.coloc> 2 6 377 46 +717us[ +825us] +/- 14ms 2026-02-17T12:21:16.860 INFO:teuthology.orchestra.run.trial162.stdout:^- 172-104-28-175.ip.linode> 2 6 377 45 -4115us[-4115us] +/- 60ms 2026-02-17T12:21:16.860 INFO:teuthology.orchestra.run.trial162.stdout:^+ frumentum-zeus.infra.fru> 2 6 377 44 -671us[ -671us] +/- 24ms 2026-02-17T12:21:16.860 INFO:teuthology.orchestra.run.trial162.stdout:^+ time7.beanman.net 2 6 377 44 +2667us[+2667us] +/- 40ms 2026-02-17T12:21:16.860 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T12:21:16.871 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T12:21:16.871 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T12:21:16.884 DEBUG:teuthology.orchestra.run.trial162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:21:16.960 DEBUG:teuthology.orchestra.run.trial162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:21:16.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:21:16.987 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T12:21:17.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T12:21:17.020 INFO:teuthology.task.internal:Duration was 474.261393 seconds 2026-02-17T12:21:17.020 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T12:21:17.041 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T12:21:17.042 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:21:17.078 INFO:teuthology.orchestra.run.trial162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:21:17.498 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T12:21:17.498 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial162.front.sepia.ceph.com 2026-02-17T12:21:17.498 DEBUG:teuthology.orchestra.run.trial162:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:21:17.556 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T12:21:17.557 DEBUG:teuthology.orchestra.run.trial162:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:21:17.698 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T12:21:17.698 DEBUG:teuthology.orchestra.run.trial162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:21:17.721 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:21:17.721 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:21:17.721 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:21:17.721 INFO:teuthology.orchestra.run.trial162.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:21:17.722 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:21:17.740 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 86.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:21:17.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T12:21:17.759 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T12:21:17.760 DEBUG:teuthology.orchestra.run.trial162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:21:17.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T12:21:17.826 DEBUG:teuthology.orchestra.run.trial162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:17.873 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern = core 2026-02-17T12:21:17.885 DEBUG:teuthology.orchestra.run.trial162:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:21:17.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:21:17.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T12:21:17.959 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T12:21:17.960 DEBUG:teuthology.misc:Transferring archived files from trial162:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51426/remote/trial162 2026-02-17T12:21:17.960 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:21:18.014 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T12:21:18.015 DEBUG:teuthology.orchestra.run.trial162:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:21:18.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T12:21:18.080 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T12:21:18.081 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T12:21:18.097 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T12:21:18.097 DEBUG:teuthology.orchestra.run.trial162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:21:18.118 INFO:teuthology.orchestra.run.trial162.stdout: 791886 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:21 /home/ubuntu/cephtest 2026-02-17T12:21:18.119 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T12:21:18.138 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T12:21:18.180 INFO:teuthology.run:Summary data: description: rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} duration: 474.26139283180237 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T12:21:18.180 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:21:18.314 INFO:teuthology.run:pass