2026-02-17T00:17:28.794 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-17T00:17:28.811 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T00:17:28.887 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50408 branch: wip-squid-pr-67199-kefu-1 description: orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} email: null first_in_suite: false flavor: default job_id: '50408' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-squid-pr-67199-kefu-1 ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - CEPHADM_FAILED_DAEMON log-only-match: - CEPHADM_ sha1: 05b55d192f002ad5df41409624b8d176527d0841 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 05b55d192f002ad5df41409624b8d176527d0841 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-squid-pr-67199-kefu-1 sha1: 05b55d192f002ad5df41409624b8d176527d0841 owner: scheduled_dgalloway@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 seed: 4155 sha1: 05b55d192f002ad5df41409624b8d176527d0841 sleep_before_teardown: 0 subset: 110/12000 suite: orch:cephadm suite_branch: wip-squid-pr-67199-kefu-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 05b55d192f002ad5df41409624b8d176527d0841 targets: trial198.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBgZFVawa6mzW/eybMhn7+i0Z7U+wg87Kd1ANgVeHVx7NbpoLUt4/QToYxfpc8UzLnUqIcs1H3RSrcw3JKt4sLk= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: null - cephadm.shell: host.a: - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - workunit: clients: client.0: - cephadm/test_iscsi_pids_limit.sh - cephadm/test_iscsi_etc_hosts.sh - cephadm/test_iscsi_setup.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_23:06:25 tube: trial user: dgalloway verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T00:17:28.888 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa; will attempt to use it 2026-02-17T00:17:28.888 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa/tasks 2026-02-17T00:17:28.888 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T00:17:28.890 INFO:teuthology.task.internal:Checking packages... 2026-02-17T00:17:28.890 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '05b55d192f002ad5df41409624b8d176527d0841' 2026-02-17T00:17:28.890 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T00:17:28.890 INFO:teuthology.packaging:ref: None 2026-02-17T00:17:28.890 INFO:teuthology.packaging:tag: None 2026-02-17T00:17:28.890 INFO:teuthology.packaging:branch: wip-squid-pr-67199-kefu-1 2026-02-17T00:17:28.890 INFO:teuthology.packaging:sha1: 05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:17:28.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-squid-pr-67199-kefu-1 2026-02-17T00:17:29.006 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-680.g05b55d19 2026-02-17T00:17:29.007 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T00:17:29.019 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T00:17:29.019 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T00:17:29.032 INFO:teuthology.task.internal:Saving configuration 2026-02-17T00:17:29.041 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T00:17:29.053 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T00:17:29.130 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial198.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50408', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 00:14:00.652001', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBgZFVawa6mzW/eybMhn7+i0Z7U+wg87Kd1ANgVeHVx7NbpoLUt4/QToYxfpc8UzLnUqIcs1H3RSrcw3JKt4sLk='} 2026-02-17T00:17:29.130 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T00:17:29.142 INFO:teuthology.task.internal:roles: ubuntu@trial198.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2026-02-17T00:17:29.142 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T00:17:29.226 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a9e9cb27880>, signals=[15]) 2026-02-17T00:17:29.226 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T00:17:29.238 INFO:teuthology.task.internal:Opening connections... 2026-02-17T00:17:29.238 DEBUG:teuthology.task.internal:connecting to ubuntu@trial198.front.sepia.ceph.com 2026-02-17T00:17:29.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:17:29.300 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T00:17:29.311 DEBUG:teuthology.orchestra.run.trial198:> uname -m 2026-02-17T00:17:29.373 INFO:teuthology.orchestra.run.trial198.stdout:x86_64 2026-02-17T00:17:29.373 DEBUG:teuthology.orchestra.run.trial198:> cat /etc/os-release 2026-02-17T00:17:29.429 INFO:teuthology.orchestra.run.trial198.stdout:NAME="CentOS Stream" 2026-02-17T00:17:29.429 INFO:teuthology.orchestra.run.trial198.stdout:VERSION="9" 2026-02-17T00:17:29.429 INFO:teuthology.orchestra.run.trial198.stdout:ID="centos" 2026-02-17T00:17:29.429 INFO:teuthology.orchestra.run.trial198.stdout:ID_LIKE="rhel fedora" 2026-02-17T00:17:29.429 INFO:teuthology.orchestra.run.trial198.stdout:VERSION_ID="9" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:PLATFORM_ID="platform:el9" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:ANSI_COLOR="0;31" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:LOGO="fedora-logo-icon" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:HOME_URL="https://centos.org/" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T00:17:29.430 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T00:17:29.431 INFO:teuthology.lock.ops:Updating trial198.front.sepia.ceph.com on lock server 2026-02-17T00:17:29.522 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T00:17:29.534 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T00:17:29.546 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T00:17:29.547 DEBUG:teuthology.orchestra.run.trial198:> test '!' -e /home/ubuntu/cephtest 2026-02-17T00:17:29.561 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T00:17:29.575 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T00:17:29.575 DEBUG:teuthology.orchestra.run.trial198:> test -z $(ls -A /var/lib/ceph) 2026-02-17T00:17:29.619 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T00:17:29.738 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T00:17:29.760 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T00:17:29.760 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T00:17:29.760 DEBUG:teuthology.orchestra.run.trial198:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T00:17:29.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:17:29.775 DEBUG:teuthology.orchestra.run.trial198:> uname -r 2026-02-17T00:17:29.831 INFO:teuthology.orchestra.run.trial198.stdout:5.14.0-645.el9.x86_64 2026-02-17T00:17:29.831 INFO:teuthology.task.kernel:Running kernel on trial198: 5.14.0-645.el9.x86_64 2026-02-17T00:17:29.831 DEBUG:teuthology.orchestra.run.trial198:> sudo yum install -y kernel 2026-02-17T00:17:31.576 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-17T00:17:34.770 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T00:17:43.159 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 7.8 MB 00:05 2026-02-17T00:17:44.239 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 20 kB 00:00 2026-02-17T00:17:44.732 INFO:teuthology.orchestra.run.trial198.stdout:Extra Packages for Enterprise Linux 47 MB/s | 20 MB 00:00 2026-02-17T00:17:47.920 INFO:teuthology.orchestra.run.trial198.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-17T00:17:48.939 INFO:teuthology.orchestra.run.trial198.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T00:17:48.959 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:17:48.960 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:17:48.961 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:17:48.962 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:17:48.962 INFO:teuthology.orchestra.run.trial198.stdout:Install 4 Packages 2026-02-17T00:17:48.962 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:17:48.962 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 88 M 2026-02-17T00:17:48.962 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 135 M 2026-02-17T00:17:48.962 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:17:49.118 INFO:teuthology.orchestra.run.trial198.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 11 MB/s | 803 kB 00:00 2026-02-17T00:17:49.209 INFO:teuthology.orchestra.run.trial198.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 107 MB/s | 17 MB 00:00 2026-02-17T00:17:49.296 INFO:teuthology.orchestra.run.trial198.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 173 MB/s | 31 MB 00:00 2026-02-17T00:17:49.361 INFO:teuthology.orchestra.run.trial198.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 127 MB/s | 40 MB 00:00 2026-02-17T00:17:49.361 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:17:49.361 INFO:teuthology.orchestra.run.trial198.stdout:Total 221 MB/s | 88 MB 00:00 2026-02-17T00:17:49.550 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:17:49.752 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:17:49.752 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:17:50.098 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:17:50.098 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:17:51.189 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:17:51.472 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:17:51.492 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:17:53.297 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:17:53.326 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:17:56.353 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:17:56.359 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:17:59.397 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:18:29.905 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:18:29.927 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:18:30.099 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:18:30.099 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:18:30.099 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:18:30.100 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:18:30.151 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:18:30.151 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:18:30.151 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:18:30.151 INFO:teuthology.orchestra.run.trial198.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.151 INFO:teuthology.orchestra.run.trial198.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.151 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.152 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.152 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:18:30.152 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:18:30.209 DEBUG:teuthology.orchestra.run.trial198:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:18:30.236 INFO:teuthology.orchestra.run.trial198.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.236 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:18:30.236 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T00:18:30.236 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T00:18:30.237 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T00:18:30.237 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-17T00:18:30.237 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial198.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T00:18:30.237 DEBUG:teuthology.orchestra.run.trial198:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:18:30.298 INFO:teuthology.orchestra.run.trial198.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.300 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:18:30.300 DEBUG:teuthology.orchestra.run.trial198:> sudo rpm -qi grub2-tools 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Name : grub2-tools 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Epoch : 1 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Version : 2.06 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Release : 118.el9 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Architecture: x86_64 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Group : Unspecified 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Size : 8393909 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:License : GPLv3+ 2026-02-17T00:18:30.368 INFO:teuthology.orchestra.run.trial198.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:Packager : builder@centos.org 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:Vendor : CentOS 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:Summary : Support tools for GRUB. 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:Description : 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T00:18:30.369 INFO:teuthology.orchestra.run.trial198.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T00:18:30.370 INFO:teuthology.orchestra.run.trial198.stdout:hardware devices. 2026-02-17T00:18:30.370 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:18:30.370 INFO:teuthology.orchestra.run.trial198.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T00:18:30.371 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T00:18:30.371 INFO:teuthology.task.kernel:Updating grub on trial198 to boot 5.14.0-681.el9.x86_64 2026-02-17T00:18:30.371 DEBUG:teuthology.orchestra.run.trial198:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T00:18:30.434 INFO:teuthology.orchestra.run.trial198.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:18:30.436 DEBUG:teuthology.orchestra.run.trial198:> sudo command -v grubby && echo yes || echo no 2026-02-17T00:18:30.500 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/grubby 2026-02-17T00:18:30.502 INFO:teuthology.orchestra.run.trial198.stdout:yes 2026-02-17T00:18:30.502 DEBUG:teuthology.orchestra.run.trial198:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T00:18:30.566 INFO:teuthology.orchestra.run.trial198.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:18:30.567 DEBUG:teuthology.orchestra.run.trial198:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.641 DEBUG:teuthology.orchestra.run.trial198:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T00:18:30.848 INFO:teuthology.orchestra.run.trial198.stderr:Generating grub configuration file ... 2026-02-17T00:18:30.911 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T00:18:30.917 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T00:18:31.170 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T00:18:31.177 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T00:18:31.208 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T00:18:31.215 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T00:18:31.238 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T00:18:31.244 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T00:18:31.325 INFO:teuthology.orchestra.run.trial198.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T00:18:31.334 INFO:teuthology.orchestra.run.trial198.stderr:done 2026-02-17T00:18:31.336 DEBUG:teuthology.orchestra.run.trial198:> test -d /sys/firmware/efi 2026-02-17T00:18:31.352 DEBUG:teuthology.orchestra.run.trial198:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T00:18:31.417 INFO:teuthology.orchestra.run.trial198.stdout:/boot/efi/EFI/BOOT 2026-02-17T00:18:31.417 INFO:teuthology.orchestra.run.trial198.stdout:/boot/efi/EFI/centos 2026-02-17T00:18:31.419 DEBUG:teuthology.orchestra.run.trial198:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T00:18:31.482 INFO:teuthology.orchestra.run.trial198.stdout:no 2026-02-17T00:18:31.483 DEBUG:teuthology.orchestra.run.trial198:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T00:18:31.547 INFO:teuthology.orchestra.run.trial198.stdout:yes 2026-02-17T00:18:31.548 DEBUG:teuthology.orchestra.run.trial198:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T00:18:31.611 DEBUG:teuthology.orchestra.run.trial198:> sudo shutdown -r now 2026-02-17T00:19:01.673 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-17T00:19:01.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T00:19:01.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:20:01.736 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T00:20:10.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T00:20:10.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:20:10.831 DEBUG:teuthology.orchestra.run.trial198:> true 2026-02-17T00:20:10.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T00:20:10.976 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T00:20:10.976 DEBUG:teuthology.orchestra.run.trial198:> uname -r 2026-02-17T00:20:11.035 INFO:teuthology.orchestra.run.trial198.stdout:5.14.0-681.el9.x86_64 2026-02-17T00:20:11.035 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T00:20:11.036 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T00:20:11.036 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T00:20:12.037 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-17T00:20:12.037 DEBUG:teuthology.orchestra.run.trial198:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T00:20:12.067 INFO:teuthology.orchestra.run.trial198.stdout:ttyS1 2026-02-17T00:20:12.090 DEBUG:teuthology.parallel:result is None 2026-02-17T00:20:12.090 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T00:20:12.101 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T00:20:12.101 DEBUG:teuthology.orchestra.run.trial198:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T00:20:12.145 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T00:20:12.160 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T00:20:12.173 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T00:20:12.174 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T00:20:12.208 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T00:20:12.220 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T00:20:12.220 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T00:20:12.267 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:20:12.276 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:20:12.278 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T00:20:12.290 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T00:20:12.291 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T00:20:12.345 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T00:20:12.362 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T00:20:12.362 DEBUG:teuthology.orchestra.run.trial198:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T00:20:12.401 DEBUG:teuthology.orchestra.run.trial198:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:20:12.584 DEBUG:teuthology.orchestra.run.trial198:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:20:12.609 DEBUG:teuthology.orchestra.run.trial198:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:20:12.741 DEBUG:teuthology.orchestra.run.trial198:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:20:12.765 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:20:12.765 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T00:20:12.830 DEBUG:teuthology.orchestra.run.trial198:> sudo service rsyslog restart 2026-02-17T00:20:12.899 INFO:teuthology.orchestra.run.trial198.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T00:20:13.241 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T00:20:13.256 INFO:teuthology.task.internal:Starting timer... 2026-02-17T00:20:13.256 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T00:20:13.274 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T00:20:13.287 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-17T00:20:13.287 DEBUG:teuthology.orchestra.run.trial198:> sudo service auditd rotate 2026-02-17T00:20:13.315 INFO:teuthology.orchestra.run.trial198.stdout:Rotating logs: 2026-02-17T00:20:13.317 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T00:20:13.317 DEBUG:teuthology.orchestra.run.trial198:> /usr/sbin/getenforce 2026-02-17T00:20:13.374 INFO:teuthology.orchestra.run.trial198.stdout:Permissive 2026-02-17T00:20:13.374 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial198.front.sepia.ceph.com': 'permissive'} 2026-02-17T00:20:13.374 DEBUG:teuthology.orchestra.run.trial198:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T00:20:13.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:20:13.441 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T00:20:13.442 DEBUG:teuthology.orchestra.run.trial198:> sudo /usr/sbin/setenforce permissive 2026-02-17T00:20:13.506 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T00:20:13.522 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T00:20:13.535 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T00:20:13.536 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial198.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T00:22:56.292 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial198.front.sepia.ceph.com')] 2026-02-17T00:22:56.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T00:22:56.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:22:56.405 DEBUG:teuthology.orchestra.run.trial198:> true 2026-02-17T00:22:56.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T00:22:56.475 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T00:22:56.487 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T00:22:56.487 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T00:22:56.488 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:22:56.542 INFO:teuthology.orchestra.run.trial198.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T00:22:56.553 INFO:teuthology.orchestra.run.trial198.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T00:22:56.573 INFO:teuthology.orchestra.run.trial198.stderr:sudo: ntpd: command not found 2026-02-17T00:22:56.583 INFO:teuthology.orchestra.run.trial198.stdout:506 Cannot talk to daemon 2026-02-17T00:22:56.594 INFO:teuthology.orchestra.run.trial198.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T00:22:56.606 INFO:teuthology.orchestra.run.trial198.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T00:22:56.657 INFO:teuthology.orchestra.run.trial198.stderr:bash: line 1: ntpq: command not found 2026-02-17T00:22:56.659 INFO:teuthology.orchestra.run.trial198.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T00:22:56.659 INFO:teuthology.orchestra.run.trial198.stdout:=============================================================================== 2026-02-17T00:22:56.660 INFO:teuthology.run_tasks:Running task pexec... 2026-02-17T00:22:56.678 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-17T00:22:56.679 DEBUG:teuthology.orchestra.run.trial198:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T00:22:56.703 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial198.front.sepia.ceph.com 2026-02-17T00:22:56.704 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T00:22:56.704 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T00:22:56.875 INFO:teuthology.orchestra.run.trial198.stdout:No match for argument: nvme-cli 2026-02-17T00:22:56.875 INFO:teuthology.orchestra.run.trial198.stderr:No packages marked for removal. 2026-02-17T00:22:56.877 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:22:56.878 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:22:56.878 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:22:57.184 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:22:26 AM UTC. 2026-02-17T00:22:57.266 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:22:57.267 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:22:57.267 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T00:22:57.267 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:22:57.267 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:22:57.267 INFO:teuthology.orchestra.run.trial198.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout:Upgrading: 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout:Install 6 Packages 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout:Upgrade 1 Package 2026-02-17T00:22:57.268 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:22:57.269 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 2.4 M 2026-02-17T00:22:57.269 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:22:58.104 INFO:teuthology.orchestra.run.trial198.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 86 kB/s | 44 kB 00:00 2026-02-17T00:22:58.193 INFO:teuthology.orchestra.run.trial198.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 120 kB/s | 72 kB 00:00 2026-02-17T00:22:58.273 INFO:teuthology.orchestra.run.trial198.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 500 kB/s | 84 kB 00:00 2026-02-17T00:22:58.527 INFO:teuthology.orchestra.run.trial198.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 450 kB/s | 150 kB 00:00 2026-02-17T00:22:58.697 INFO:teuthology.orchestra.run.trial198.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 687 kB/s | 116 kB 00:00 2026-02-17T00:22:59.338 INFO:teuthology.orchestra.run.trial198.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 786 kB/s | 837 kB 00:01 2026-02-17T00:22:59.406 INFO:teuthology.orchestra.run.trial198.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 651 kB/s | 1.2 MB 00:01 2026-02-17T00:22:59.409 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:22:59.409 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.1 MB/s | 2.4 MB 00:02 2026-02-17T00:22:59.476 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:22:59.484 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:22:59.484 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:22:59.535 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:22:59.535 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:22:59.604 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:22:59.671 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-17T00:22:59.677 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-17T00:22:59.686 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-17T00:22:59.692 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-17T00:22:59.697 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-17T00:22:59.698 INFO:teuthology.orchestra.run.trial198.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T00:22:59.831 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T00:22:59.833 INFO:teuthology.orchestra.run.trial198.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T00:23:00.113 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T00:23:00.113 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T00:23:00.113 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:00.135 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:23:00.365 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:23:00.365 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-17T00:23:00.365 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-17T00:23:00.365 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-17T00:23:00.365 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-17T00:23:00.365 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-17T00:23:00.366 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-17T00:23:00.366 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-17T00:23:00.419 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:23:00.419 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:00.419 INFO:teuthology.orchestra.run.trial198.stdout:Upgraded: 2026-02-17T00:23:00.419 INFO:teuthology.orchestra.run.trial198.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T00:23:00.420 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:00.420 INFO:teuthology.orchestra.run.trial198.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T00:23:00.420 INFO:teuthology.orchestra.run.trial198.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T00:23:00.420 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T00:23:00.420 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:00.420 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:00.450 DEBUG:teuthology.parallel:result is None 2026-02-17T00:23:00.451 INFO:teuthology.run_tasks:Running task install... 2026-02-17T00:23:00.466 DEBUG:teuthology.task.install:project ceph 2026-02-17T00:23:00.467 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'}} 2026-02-17T00:23:00.467 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'} 2026-02-17T00:23:00.467 INFO:teuthology.task.install:Using flavor: default 2026-02-17T00:23:00.476 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T00:23:00.476 INFO:teuthology.task.install:extra packages: [] 2026-02-17T00:23:00.477 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'tag': None, 'wait_for_package': False} 2026-02-17T00:23:00.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:23:00.632 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/ 2026-02-17T00:23:00.632 INFO:teuthology.task.install.rpm:Package version is 19.2.3-680.g05b55d19 2026-02-17T00:23:00.758 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T00:23:00.759 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:23:00.759 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T00:23:00.788 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T00:23:00.788 DEBUG:teuthology.orchestra.run.trial198:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/05b55d192f002ad5df41409624b8d176527d0841/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T00:23:00.853 DEBUG:teuthology.orchestra.run.trial198:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T00:23:00.927 DEBUG:teuthology.orchestra.run.trial198:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T00:23:00.991 INFO:teuthology.orchestra.run.trial198.stdout:check_obsoletes = 1 2026-02-17T00:23:00.993 DEBUG:teuthology.orchestra.run.trial198:> sudo yum clean all 2026-02-17T00:23:01.145 INFO:teuthology.orchestra.run.trial198.stdout:41 files removed 2026-02-17T00:23:01.159 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-radosgw 2026-02-17T00:23:01.442 INFO:teuthology.orchestra.run.trial198.stdout:ceph packages for x86_64 619 kB/s | 86 kB 00:00 2026-02-17T00:23:01.575 INFO:teuthology.orchestra.run.trial198.stdout:ceph noarch packages 112 kB/s | 12 kB 00:00 2026-02-17T00:23:01.701 INFO:teuthology.orchestra.run.trial198.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T00:23:02.519 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T00:23:05.767 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-17T00:23:09.090 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 7.8 MB 00:00 2026-02-17T00:23:10.711 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-17T00:23:11.564 INFO:teuthology.orchestra.run.trial198.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-17T00:23:14.787 INFO:teuthology.orchestra.run.trial198.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T00:23:16.021 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repository Size 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: ceph-radosgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 11 M 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout:Upgrading: 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: librados2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.4 M 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: librbd1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.2 M 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: ceph-base x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.5 M 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 22 M 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: ceph-selinux x86_64 2:19.2.3-680.g05b55d19.el9 ceph 25 k 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 998 k 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T00:23:16.022 INFO:teuthology.orchestra.run.trial198.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: libradosstriper1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 503 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: librgw2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.4 M 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-argparse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 45 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 154 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: python3-cephfs x86_64 2:19.2.3-680.g05b55d19.el9 ceph 165 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: python3-rados x86_64 2:19.2.3-680.g05b55d19.el9 ceph 323 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: python3-rbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 302 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: python3-rgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 100 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout:Installing weak dependencies: 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout:Install 32 Packages 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout:Upgrade 2 Packages 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 62 M 2026-02-17T00:23:16.023 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:16.664 INFO:teuthology.orchestra.run.trial198.stdout:(1/34): ceph-base-19.2.3-680.g05b55d19.el9.x86_ 14 MB/s | 5.5 MB 00:00 2026-02-17T00:23:16.708 INFO:teuthology.orchestra.run.trial198.stdout:(2/34): ceph-selinux-19.2.3-680.g05b55d19.el9.x 569 kB/s | 25 kB 00:00 2026-02-17T00:23:16.774 INFO:teuthology.orchestra.run.trial198.stdout:(3/34): libcephfs2-19.2.3-680.g05b55d19.el9.x86 15 MB/s | 998 kB 00:00 2026-02-17T00:23:16.833 INFO:teuthology.orchestra.run.trial198.stdout:(4/34): libradosstriper1-19.2.3-680.g05b55d19.e 8.4 MB/s | 503 kB 00:00 2026-02-17T00:23:16.880 INFO:teuthology.orchestra.run.trial198.stdout:(5/34): ceph-radosgw-19.2.3-680.g05b55d19.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T00:23:16.923 INFO:teuthology.orchestra.run.trial198.stdout:(6/34): python3-ceph-argparse-19.2.3-680.g05b55 1.0 MB/s | 45 kB 00:00 2026-02-17T00:23:16.977 INFO:teuthology.orchestra.run.trial198.stdout:(7/34): python3-ceph-common-19.2.3-680.g05b55d1 2.8 MB/s | 154 kB 00:00 2026-02-17T00:23:17.034 INFO:teuthology.orchestra.run.trial198.stdout:(8/34): python3-cephfs-19.2.3-680.g05b55d19.el9 2.8 MB/s | 165 kB 00:00 2026-02-17T00:23:17.096 INFO:teuthology.orchestra.run.trial198.stdout:(9/34): python3-rados-19.2.3-680.g05b55d19.el9. 5.0 MB/s | 323 kB 00:00 2026-02-17T00:23:17.115 INFO:teuthology.orchestra.run.trial198.stdout:(10/34): librgw2-19.2.3-680.g05b55d19.el9.x86_6 19 MB/s | 5.4 MB 00:00 2026-02-17T00:23:17.163 INFO:teuthology.orchestra.run.trial198.stdout:(11/34): ceph-common-19.2.3-680.g05b55d19.el9.x 25 MB/s | 22 MB 00:00 2026-02-17T00:23:17.164 INFO:teuthology.orchestra.run.trial198.stdout:(12/34): python3-rgw-19.2.3-680.g05b55d19.el9.x 2.0 MB/s | 100 kB 00:00 2026-02-17T00:23:17.165 INFO:teuthology.orchestra.run.trial198.stdout:(13/34): python3-rbd-19.2.3-680.g05b55d19.el9.x 4.3 MB/s | 302 kB 00:00 2026-02-17T00:23:17.238 INFO:teuthology.orchestra.run.trial198.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 1.4 MB/s | 104 kB 00:00 2026-02-17T00:23:17.272 INFO:teuthology.orchestra.run.trial198.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 4.7 MB/s | 164 kB 00:00 2026-02-17T00:23:17.301 INFO:teuthology.orchestra.run.trial198.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.4 MB/s | 160 kB 00:00 2026-02-17T00:23:17.329 INFO:teuthology.orchestra.run.trial198.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.6 MB/s | 45 kB 00:00 2026-02-17T00:23:17.363 INFO:teuthology.orchestra.run.trial198.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 662 kB 00:00 2026-02-17T00:23:17.391 INFO:teuthology.orchestra.run.trial198.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 10 MB/s | 292 kB 00:00 2026-02-17T00:23:17.421 INFO:teuthology.orchestra.run.trial198.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 7.7 MB/s | 240 kB 00:00 2026-02-17T00:23:17.450 INFO:teuthology.orchestra.run.trial198.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.3 MB/s | 37 kB 00:00 2026-02-17T00:23:17.478 INFO:teuthology.orchestra.run.trial198.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.3 MB/s | 66 kB 00:00 2026-02-17T00:23:17.576 INFO:teuthology.orchestra.run.trial198.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.1 MB/s | 308 kB 00:00 2026-02-17T00:23:17.682 INFO:teuthology.orchestra.run.trial198.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 42 MB/s | 4.4 MB 00:00 2026-02-17T00:23:17.726 INFO:teuthology.orchestra.run.trial198.stdout:(25/34): mailcap-2.1.49-5.el9.noarch.rpm 59 kB/s | 33 kB 00:00 2026-02-17T00:23:17.749 INFO:teuthology.orchestra.run.trial198.stdout:(26/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 373 kB/s | 25 kB 00:00 2026-02-17T00:23:17.759 INFO:teuthology.orchestra.run.trial198.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 6.0 MB/s | 67 kB 00:00 2026-02-17T00:23:17.778 INFO:teuthology.orchestra.run.trial198.stdout:(28/34): liboath-2.6.12-1.el9.x86_64.rpm 944 kB/s | 49 kB 00:00 2026-02-17T00:23:17.800 INFO:teuthology.orchestra.run.trial198.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 20 MB/s | 838 kB 00:00 2026-02-17T00:23:17.828 INFO:teuthology.orchestra.run.trial198.stdout:(30/34): pciutils-3.7.0-7.el9.x86_64.rpm 140 kB/s | 93 kB 00:00 2026-02-17T00:23:17.840 INFO:teuthology.orchestra.run.trial198.stdout:(31/34): re2-20211101-20.el9.x86_64.rpm 3.0 MB/s | 191 kB 00:00 2026-02-17T00:23:17.925 INFO:teuthology.orchestra.run.trial198.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-17T00:23:17.929 INFO:teuthology.orchestra.run.trial198.stdout:(33/34): librados2-19.2.3-680.g05b55d19.el9.x86 34 MB/s | 3.4 MB 00:00 2026-02-17T00:23:17.952 INFO:teuthology.orchestra.run.trial198.stdout:(34/34): librbd1-19.2.3-680.g05b55d19.el9.x86_6 28 MB/s | 3.2 MB 00:00 2026-02-17T00:23:17.954 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:17.954 INFO:teuthology.orchestra.run.trial198.stdout:Total 32 MB/s | 62 MB 00:01 2026-02-17T00:23:18.051 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:18.069 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:18.069 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:18.298 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:18.299 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:18.581 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:18.589 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-17T00:23:18.591 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-17T00:23:18.603 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-17T00:23:18.753 INFO:teuthology.orchestra.run.trial198.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-17T00:23:18.759 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-17T00:23:18.790 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-17T00:23:18.832 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-17T00:23:18.833 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-17T00:23:18.846 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-17T00:23:18.851 INFO:teuthology.orchestra.run.trial198.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-17T00:23:18.861 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 9/36 2026-02-17T00:23:18.884 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-17T00:23:18.884 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-17T00:23:18.898 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-17T00:23:18.928 INFO:teuthology.orchestra.run.trial198.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-17T00:23:18.932 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-17T00:23:18.939 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-17T00:23:18.941 INFO:teuthology.orchestra.run.trial198.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-17T00:23:18.944 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-17T00:23:18.948 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-17T00:23:19.087 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-17T00:23:19.088 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-17T00:23:19.114 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-17T00:23:19.116 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 20/36 2026-02-17T00:23:19.122 INFO:teuthology.orchestra.run.trial198.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-17T00:23:19.347 INFO:teuthology.orchestra.run.trial198.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-17T00:23:19.348 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-17T00:23:19.364 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-17T00:23:19.368 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 24/36 2026-02-17T00:23:19.374 INFO:teuthology.orchestra.run.trial198.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-17T00:23:19.376 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-17T00:23:19.377 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T00:23:19.394 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T00:23:19.396 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-17T00:23:19.425 INFO:teuthology.orchestra.run.trial198.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-17T00:23:19.426 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 30/36 2026-02-17T00:23:20.408 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-17T00:23:20.410 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-17T00:23:20.691 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-17T00:23:20.694 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-17T00:23:20.732 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-17T00:23:20.733 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T00:23:20.733 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T00:23:20.733 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:20.737 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-17T00:23:25.278 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /sys 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /proc 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /mnt 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /var/tmp 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /home 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /root 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /tmp 2026-02-17T00:23:25.279 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:25.731 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-17T00:23:25.754 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-17T00:23:25.754 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:25.755 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T00:23:25.755 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T00:23:25.755 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T00:23:25.755 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:25.756 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T00:23:25.770 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T00:23:25.770 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T00:23:25.826 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T00:23:25.826 INFO:teuthology.orchestra.run.trial198.stdout:Creating group 'qat' with GID 992. 2026-02-17T00:23:25.826 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:26.108 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 1/36 2026-02-17T00:23:26.108 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 3/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 4/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 8/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 9/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-17T00:23:26.109 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 12/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 13/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-17T00:23:26.110 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-17T00:23:26.111 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 35/36 2026-02-17T00:23:26.167 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout:Upgraded: 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.168 INFO:teuthology.orchestra.run.trial198.stdout: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T00:23:26.169 INFO:teuthology.orchestra.run.trial198.stdout: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.170 INFO:teuthology.orchestra.run.trial198.stdout: python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout: python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:26.171 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:26.211 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-test 2026-02-17T00:23:26.520 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:26.603 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:26.604 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:26.604 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repository Size 2026-02-17T00:23:26.604 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:26.604 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:26.604 INFO:teuthology.orchestra.run.trial198.stdout: ceph-test x86_64 2:19.2.3-680.g05b55d19.el9 ceph 50 M 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout: libcephsqlite x86_64 2:19.2.3-680.g05b55d19.el9 ceph 163 k 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout:Install 5 Packages 2026-02-17T00:23:26.605 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:26.606 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 50 M 2026-02-17T00:23:26.606 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 212 M 2026-02-17T00:23:26.606 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:26.986 INFO:teuthology.orchestra.run.trial198.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.1 MB/s | 233 kB 00:00 2026-02-17T00:23:26.999 INFO:teuthology.orchestra.run.trial198.stdout:(2/5): libcephsqlite-19.2.3-680.g05b55d19.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-17T00:23:27.017 INFO:teuthology.orchestra.run.trial198.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 9.4 MB/s | 303 kB 00:00 2026-02-17T00:23:27.026 INFO:teuthology.orchestra.run.trial198.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.3 MB/s | 64 kB 00:00 2026-02-17T00:23:27.931 INFO:teuthology.orchestra.run.trial198.stdout:(5/5): ceph-test-19.2.3-680.g05b55d19.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T00:23:27.932 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:27.933 INFO:teuthology.orchestra.run.trial198.stdout:Total 38 MB/s | 50 MB 00:01 2026-02-17T00:23:27.959 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:27.969 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:27.969 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:28.156 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:28.156 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:28.368 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:28.374 INFO:teuthology.orchestra.run.trial198.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T00:23:28.379 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T00:23:28.387 INFO:teuthology.orchestra.run.trial198.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T00:23:28.388 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-17T00:23:30.637 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-17T00:23:30.655 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-17T00:23:30.873 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-17T00:23:30.873 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 1/5 2026-02-17T00:23:30.873 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2/5 2026-02-17T00:23:30.873 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T00:23:30.873 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T00:23:30.926 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T00:23:30.926 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:30.927 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:30.961 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph 2026-02-17T00:23:31.272 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:31.357 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout:====================================================================================== 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repository Size 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout:====================================================================================== 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout: ceph x86_64 2:19.2.3-680.g05b55d19.el9 ceph 6.5 k 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout: ceph-grafana-dashboards noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 31 k 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mds x86_64 2:19.2.3-680.g05b55d19.el9 ceph 2.4 M 2026-02-17T00:23:31.360 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.1 M 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-modules-core noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 253 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mon x86_64 2:19.2.3-680.g05b55d19.el9 ceph 4.7 M 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 17 M 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: ceph-prometheus-alerts noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 17 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 769 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T00:23:31.361 INFO:teuthology.orchestra.run.trial198.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T00:23:31.362 INFO:teuthology.orchestra.run.trial198.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T00:23:31.363 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T00:23:31.364 INFO:teuthology.orchestra.run.trial198.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T00:23:31.365 INFO:teuthology.orchestra.run.trial198.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T00:23:31.366 INFO:teuthology.orchestra.run.trial198.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T00:23:31.367 INFO:teuthology.orchestra.run.trial198.stdout:Installing weak dependencies: 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 150 k 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-dashboard noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 3.8 M 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 7.4 M 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 22 k 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-rook noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 49 k 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: ceph-volume noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 298 k 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:31.368 INFO:teuthology.orchestra.run.trial198.stdout:====================================================================================== 2026-02-17T00:23:31.369 INFO:teuthology.orchestra.run.trial198.stdout:Install 98 Packages 2026-02-17T00:23:31.369 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:31.369 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 95 M 2026-02-17T00:23:31.370 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 519 M 2026-02-17T00:23:31.370 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:31.738 INFO:teuthology.orchestra.run.trial198.stdout:(1/98): ceph-19.2.3-680.g05b55d19.el9.x86_64.rp 113 kB/s | 6.5 kB 00:00 2026-02-17T00:23:31.852 INFO:teuthology.orchestra.run.trial198.stdout:(2/98): ceph-mds-19.2.3-680.g05b55d19.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T00:23:31.943 INFO:teuthology.orchestra.run.trial198.stdout:(3/98): ceph-mgr-19.2.3-680.g05b55d19.el9.x86_6 4.1 MB/s | 1.1 MB 00:00 2026-02-17T00:23:31.958 INFO:teuthology.orchestra.run.trial198.stdout:(4/98): ceph-mon-19.2.3-680.g05b55d19.el9.x86_6 22 MB/s | 4.7 MB 00:00 2026-02-17T00:23:31.974 INFO:teuthology.orchestra.run.trial198.stdout:(5/98): ceph-grafana-dashboards-19.2.3-680.g05b 1.0 MB/s | 31 kB 00:00 2026-02-17T00:23:31.985 INFO:teuthology.orchestra.run.trial198.stdout:(6/98): ceph-mgr-cephadm-19.2.3-680.g05b55d19.e 5.6 MB/s | 150 kB 00:00 2026-02-17T00:23:32.283 INFO:teuthology.orchestra.run.trial198.stdout:(7/98): ceph-mgr-diskprediction-local-19.2.3-68 25 MB/s | 7.4 MB 00:00 2026-02-17T00:23:32.317 INFO:teuthology.orchestra.run.trial198.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-680.g05b55d19 662 kB/s | 22 kB 00:00 2026-02-17T00:23:32.360 INFO:teuthology.orchestra.run.trial198.stdout:(9/98): ceph-mgr-modules-core-19.2.3-680.g05b55 5.7 MB/s | 253 kB 00:00 2026-02-17T00:23:32.408 INFO:teuthology.orchestra.run.trial198.stdout:(10/98): ceph-osd-19.2.3-680.g05b55d19.el9.x86_ 31 MB/s | 17 MB 00:00 2026-02-17T00:23:32.409 INFO:teuthology.orchestra.run.trial198.stdout:(11/98): ceph-mgr-rook-19.2.3-680.g05b55d19.el9 1.0 MB/s | 49 kB 00:00 2026-02-17T00:23:32.424 INFO:teuthology.orchestra.run.trial198.stdout:(12/98): ceph-mgr-dashboard-19.2.3-680.g05b55d1 8.5 MB/s | 3.8 MB 00:00 2026-02-17T00:23:32.424 INFO:teuthology.orchestra.run.trial198.stdout:(13/98): ceph-prometheus-alerts-19.2.3-680.g05b 1.0 MB/s | 17 kB 00:00 2026-02-17T00:23:32.425 INFO:teuthology.orchestra.run.trial198.stdout:(14/98): ceph-volume-19.2.3-680.g05b55d19.el9.n 18 MB/s | 298 kB 00:00 2026-02-17T00:23:32.448 INFO:teuthology.orchestra.run.trial198.stdout:(15/98): cephadm-19.2.3-680.g05b55d19.el9.noarc 31 MB/s | 769 kB 00:00 2026-02-17T00:23:32.525 INFO:teuthology.orchestra.run.trial198.stdout:(16/98): libconfig-1.7.2-9.el9.x86_64.rpm 942 kB/s | 72 kB 00:00 2026-02-17T00:23:32.591 INFO:teuthology.orchestra.run.trial198.stdout:(17/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 245 kB/s | 40 kB 00:00 2026-02-17T00:23:32.601 INFO:teuthology.orchestra.run.trial198.stdout:(18/98): libgfortran-11.5.0-14.el9.x86_64.rpm 10 MB/s | 794 kB 00:00 2026-02-17T00:23:32.623 INFO:teuthology.orchestra.run.trial198.stdout:(19/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 11 MB/s | 253 kB 00:00 2026-02-17T00:23:32.651 INFO:teuthology.orchestra.run.trial198.stdout:(20/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 1.5 MB/s | 350 kB 00:00 2026-02-17T00:23:32.656 INFO:teuthology.orchestra.run.trial198.stdout:(21/98): libquadmath-11.5.0-14.el9.x86_64.rpm 2.7 MB/s | 184 kB 00:00 2026-02-17T00:23:32.675 INFO:teuthology.orchestra.run.trial198.stdout:(22/98): python3-ply-3.11-14.el9.noarch.rpm 4.3 MB/s | 106 kB 00:00 2026-02-17T00:23:32.682 INFO:teuthology.orchestra.run.trial198.stdout:(23/98): python3-pycparser-2.20-6.el9.noarch.rp 5.2 MB/s | 135 kB 00:00 2026-02-17T00:23:32.699 INFO:teuthology.orchestra.run.trial198.stdout:(24/98): python3-requests-2.25.1-10.el9.noarch. 5.4 MB/s | 126 kB 00:00 2026-02-17T00:23:32.707 INFO:teuthology.orchestra.run.trial198.stdout:(25/98): python3-urllib3-1.26.5-7.el9.noarch.rp 8.4 MB/s | 218 kB 00:00 2026-02-17T00:23:32.724 INFO:teuthology.orchestra.run.trial198.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 7.0 MB/s | 182 kB 00:00 2026-02-17T00:23:32.735 INFO:teuthology.orchestra.run.trial198.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 9.6 MB/s | 266 kB 00:00 2026-02-17T00:23:32.777 INFO:teuthology.orchestra.run.trial198.stdout:(28/98): python3-cryptography-36.0.1-5.el9.x86_ 8.1 MB/s | 1.2 MB 00:00 2026-02-17T00:23:32.980 INFO:teuthology.orchestra.run.trial198.stdout:(29/98): flexiblas-3.0.4-9.el9.x86_64.rpm 116 kB/s | 30 kB 00:00 2026-02-17T00:23:33.008 INFO:teuthology.orchestra.run.trial198.stdout:(30/98): flexiblas-openblas-openmp-3.0.4-9.el9. 64 kB/s | 15 kB 00:00 2026-02-17T00:23:33.310 INFO:teuthology.orchestra.run.trial198.stdout:(31/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 746 kB/s | 246 kB 00:00 2026-02-17T00:23:33.332 INFO:teuthology.orchestra.run.trial198.stdout:(32/98): lua-5.4.4-4.el9.x86_64.rpm 582 kB/s | 188 kB 00:00 2026-02-17T00:23:33.395 INFO:teuthology.orchestra.run.trial198.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 495 kB/s | 42 kB 00:00 2026-02-17T00:23:33.539 INFO:teuthology.orchestra.run.trial198.stdout:(34/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 3.7 MB/s | 3.0 MB 00:00 2026-02-17T00:23:33.653 INFO:teuthology.orchestra.run.trial198.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2026-02-17T00:23:33.742 INFO:teuthology.orchestra.run.trial198.stdout:(36/98): python3-devel-3.9.25-2.el9.x86_64.rpm 2.7 MB/s | 244 kB 00:00 2026-02-17T00:23:33.807 INFO:teuthology.orchestra.run.trial198.stdout:(37/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 11 MB/s | 5.3 MB 00:00 2026-02-17T00:23:33.814 INFO:teuthology.orchestra.run.trial198.stdout:(38/98): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2026-02-17T00:23:33.831 INFO:teuthology.orchestra.run.trial198.stdout:(39/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.7 MB/s | 249 kB 00:00 2026-02-17T00:23:33.888 INFO:teuthology.orchestra.run.trial198.stdout:(40/98): python3-libstoragemgmt-1.10.1-1.el9.x8 2.1 MB/s | 177 kB 00:00 2026-02-17T00:23:33.911 INFO:teuthology.orchestra.run.trial198.stdout:(41/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2026-02-17T00:23:33.931 INFO:teuthology.orchestra.run.trial198.stdout:(42/98): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2026-02-17T00:23:33.967 INFO:teuthology.orchestra.run.trial198.stdout:(43/98): python3-markupsafe-1.1.1-12.el9.x86_64 440 kB/s | 35 kB 00:00 2026-02-17T00:23:34.029 INFO:teuthology.orchestra.run.trial198.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.4 MB/s | 442 kB 00:00 2026-02-17T00:23:34.048 INFO:teuthology.orchestra.run.trial198.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 967 kB/s | 77 kB 00:00 2026-02-17T00:23:34.118 INFO:teuthology.orchestra.run.trial198.stdout:(46/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 30 MB/s | 6.1 MB 00:00 2026-02-17T00:23:34.118 INFO:teuthology.orchestra.run.trial198.stdout:(47/98): python3-protobuf-3.14.0-17.el9.noarch. 2.9 MB/s | 267 kB 00:00 2026-02-17T00:23:34.128 INFO:teuthology.orchestra.run.trial198.stdout:(48/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2026-02-17T00:23:34.198 INFO:teuthology.orchestra.run.trial198.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 674 kB/s | 54 kB 00:00 2026-02-17T00:23:34.205 INFO:teuthology.orchestra.run.trial198.stdout:(50/98): python3-pyasn1-modules-0.4.8-6.el9.noa 3.1 MB/s | 279 kB 00:00 2026-02-17T00:23:34.277 INFO:teuthology.orchestra.run.trial198.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 528 kB/s | 42 kB 00:00 2026-02-17T00:23:34.288 INFO:teuthology.orchestra.run.trial198.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.2 MB/s | 189 kB 00:00 2026-02-17T00:23:34.358 INFO:teuthology.orchestra.run.trial198.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-17T00:23:34.789 INFO:teuthology.orchestra.run.trial198.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 44 kB/s | 22 kB 00:00 2026-02-17T00:23:34.834 INFO:teuthology.orchestra.run.trial198.stdout:(55/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 27 MB/s | 19 MB 00:00 2026-02-17T00:23:35.015 INFO:teuthology.orchestra.run.trial198.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 108 kB/s | 19 kB 00:00 2026-02-17T00:23:35.159 INFO:teuthology.orchestra.run.trial198.stdout:(57/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.5 MB/s | 551 kB 00:00 2026-02-17T00:23:35.162 INFO:teuthology.orchestra.run.trial198.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2026-02-17T00:23:35.212 INFO:teuthology.orchestra.run.trial198.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 591 kB/s | 29 kB 00:00 2026-02-17T00:23:35.230 INFO:teuthology.orchestra.run.trial198.stdout:(60/98): python3-asyncssh-2.13.2-5.el9.noarch.r 7.4 MB/s | 548 kB 00:00 2026-02-17T00:23:35.264 INFO:teuthology.orchestra.run.trial198.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 1.1 MB/s | 60 kB 00:00 2026-02-17T00:23:35.275 INFO:teuthology.orchestra.run.trial198.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 980 kB/s | 43 kB 00:00 2026-02-17T00:23:35.312 INFO:teuthology.orchestra.run.trial198.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 679 kB/s | 32 kB 00:00 2026-02-17T00:23:35.320 INFO:teuthology.orchestra.run.trial198.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 315 kB/s | 14 kB 00:00 2026-02-17T00:23:35.379 INFO:teuthology.orchestra.run.trial198.stdout:(65/98): python3-cherrypy-18.6.1-2.el9.noarch.r 5.9 MB/s | 358 kB 00:00 2026-02-17T00:23:35.384 INFO:teuthology.orchestra.run.trial198.stdout:(66/98): python3-cheroot-10.0.1-4.el9.noarch.rp 2.3 MB/s | 173 kB 00:00 2026-02-17T00:23:35.433 INFO:teuthology.orchestra.run.trial198.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 4.6 MB/s | 254 kB 00:00 2026-02-17T00:23:35.482 INFO:teuthology.orchestra.run.trial198.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 2.9 MB/s | 144 kB 00:00 2026-02-17T00:23:35.531 INFO:teuthology.orchestra.run.trial198.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 2.8 MB/s | 139 kB 00:00 2026-02-17T00:23:35.576 INFO:teuthology.orchestra.run.trial198.stdout:(70/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2026-02-17T00:23:35.577 INFO:teuthology.orchestra.run.trial198.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 1.2 MB/s | 56 kB 00:00 2026-02-17T00:23:35.620 INFO:teuthology.orchestra.run.trial198.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 249 kB/s | 11 kB 00:00 2026-02-17T00:23:35.620 INFO:teuthology.orchestra.run.trial198.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 410 kB/s | 18 kB 00:00 2026-02-17T00:23:35.663 INFO:teuthology.orchestra.run.trial198.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 539 kB/s | 23 kB 00:00 2026-02-17T00:23:35.663 INFO:teuthology.orchestra.run.trial198.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 456 kB/s | 20 kB 00:00 2026-02-17T00:23:35.706 INFO:teuthology.orchestra.run.trial198.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 451 kB/s | 19 kB 00:00 2026-02-17T00:23:35.707 INFO:teuthology.orchestra.run.trial198.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 612 kB/s | 26 kB 00:00 2026-02-17T00:23:35.755 INFO:teuthology.orchestra.run.trial198.stdout:(78/98): python3-logutils-0.3.5-21.el9.noarch.r 947 kB/s | 46 kB 00:00 2026-02-17T00:23:35.764 INFO:teuthology.orchestra.run.trial198.stdout:(79/98): python3-kubernetes-26.1.0-3.el9.noarch 17 MB/s | 1.0 MB 00:00 2026-02-17T00:23:35.770 INFO:teuthology.orchestra.run.trial198.stdout:(80/98): protobuf-compiler-3.14.0-17.el9.x86_64 610 kB/s | 862 kB 00:01 2026-02-17T00:23:35.802 INFO:teuthology.orchestra.run.trial198.stdout:(81/98): python3-more-itertools-8.12.0-2.el9.no 1.7 MB/s | 79 kB 00:00 2026-02-17T00:23:35.808 INFO:teuthology.orchestra.run.trial198.stdout:(82/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.9 MB/s | 86 kB 00:00 2026-02-17T00:23:35.851 INFO:teuthology.orchestra.run.trial198.stdout:(83/98): python3-portend-3.1.0-2.el9.noarch.rpm 383 kB/s | 16 kB 00:00 2026-02-17T00:23:35.858 INFO:teuthology.orchestra.run.trial198.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 4.8 MB/s | 272 kB 00:00 2026-02-17T00:23:35.895 INFO:teuthology.orchestra.run.trial198.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.0 MB/s | 90 kB 00:00 2026-02-17T00:23:35.901 INFO:teuthology.orchestra.run.trial198.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 712 kB/s | 31 kB 00:00 2026-02-17T00:23:35.941 INFO:teuthology.orchestra.run.trial198.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 4.0 MB/s | 188 kB 00:00 2026-02-17T00:23:35.946 INFO:teuthology.orchestra.run.trial198.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2026-02-17T00:23:35.985 INFO:teuthology.orchestra.run.trial198.stdout:(89/98): python3-saml-1.16.0-1.el9.noarch.rpm 2.7 MB/s | 125 kB 00:00 2026-02-17T00:23:35.989 INFO:teuthology.orchestra.run.trial198.stdout:(90/98): python3-tempora-5.0.0-2.el9.noarch.rpm 827 kB/s | 36 kB 00:00 2026-02-17T00:23:35.993 INFO:teuthology.orchestra.run.trial198.stdout:(91/98): python3-natsort-7.1.1-5.el9.noarch.rpm 259 kB/s | 58 kB 00:00 2026-02-17T00:23:36.029 INFO:teuthology.orchestra.run.trial198.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 1.9 MB/s | 86 kB 00:00 2026-02-17T00:23:36.042 INFO:teuthology.orchestra.run.trial198.stdout:(93/98): python3-webob-1.8.8-2.el9.noarch.rpm 4.2 MB/s | 230 kB 00:00 2026-02-17T00:23:36.078 INFO:teuthology.orchestra.run.trial198.stdout:(94/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.5 MB/s | 427 kB 00:00 2026-02-17T00:23:36.082 INFO:teuthology.orchestra.run.trial198.stdout:(95/98): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2026-02-17T00:23:36.087 INFO:teuthology.orchestra.run.trial198.stdout:(96/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-17T00:23:36.123 INFO:teuthology.orchestra.run.trial198.stdout:(97/98): python3-xmltodict-0.12.0-15.el9.noarch 499 kB/s | 22 kB 00:00 2026-02-17T00:23:36.128 INFO:teuthology.orchestra.run.trial198.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 437 kB/s | 20 kB 00:00 2026-02-17T00:23:36.131 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:36.131 INFO:teuthology.orchestra.run.trial198.stdout:Total 20 MB/s | 95 MB 00:04 2026-02-17T00:23:36.562 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:36.599 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:36.599 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:37.012 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:37.012 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:37.450 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:37.452 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-17T00:23:37.484 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-17T00:23:37.488 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-17T00:23:37.510 INFO:teuthology.orchestra.run.trial198.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-17T00:23:37.521 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-17T00:23:37.526 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-17T00:23:37.559 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-17T00:23:37.568 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-17T00:23:37.573 INFO:teuthology.orchestra.run.trial198.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-17T00:23:37.576 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-17T00:23:37.580 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-17T00:23:37.603 INFO:teuthology.orchestra.run.trial198.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-17T00:23:37.616 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-17T00:23:37.619 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-17T00:23:37.625 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-17T00:23:37.626 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-17T00:23:37.638 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T00:23:37.644 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-17T00:23:37.668 INFO:teuthology.orchestra.run.trial198.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-17T00:23:37.671 INFO:teuthology.orchestra.run.trial198.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-17T00:23:37.678 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-17T00:23:37.702 INFO:teuthology.orchestra.run.trial198.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-17T00:23:37.753 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-17T00:23:37.766 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-17T00:23:37.769 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-17T00:23:37.773 INFO:teuthology.orchestra.run.trial198.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-17T00:23:37.778 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-17T00:23:37.783 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-17T00:23:37.786 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-17T00:23:37.801 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-17T00:23:37.822 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-17T00:23:37.827 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-17T00:23:37.832 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-17T00:23:37.843 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-17T00:23:37.852 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-17T00:23:37.858 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-17T00:23:37.878 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-17T00:23:37.887 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-17T00:23:37.941 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-17T00:23:37.953 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-17T00:23:37.969 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-17T00:23:37.973 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-17T00:23:37.981 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-17T00:23:38.021 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-17T00:23:38.345 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-17T00:23:38.355 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-17T00:23:38.359 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-17T00:23:38.365 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-17T00:23:38.367 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-17T00:23:38.395 INFO:teuthology.orchestra.run.trial198.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-17T00:23:38.438 INFO:teuthology.orchestra.run.trial198.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-17T00:23:38.444 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-17T00:23:38.448 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-17T00:23:38.454 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-17T00:23:38.457 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-17T00:23:38.465 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-17T00:23:38.468 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-17T00:23:38.496 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-17T00:23:38.505 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-17T00:23:38.540 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-17T00:23:38.764 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-17T00:23:38.788 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-17T00:23:38.792 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-17T00:23:38.851 INFO:teuthology.orchestra.run.trial198.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-17T00:23:38.853 INFO:teuthology.orchestra.run.trial198.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-17T00:23:38.874 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-17T00:23:39.199 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-17T00:23:39.272 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-17T00:23:39.942 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-17T00:23:39.961 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-17T00:23:39.974 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-17T00:23:39.990 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-17T00:23:40.066 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-17T00:23:40.074 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-17T00:23:40.097 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-17T00:23:40.127 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-17T00:23:40.178 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-17T00:23:40.184 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-17T00:23:40.189 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-17T00:23:40.191 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-17T00:23:40.211 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T00:23:40.211 INFO:teuthology.orchestra.run.trial198.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T00:23:40.211 INFO:teuthology.orchestra.run.trial198.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T00:23:40.211 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:40.218 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T00:23:40.245 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T00:23:40.245 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T00:23:40.245 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:40.283 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-17T00:23:40.348 INFO:teuthology.orchestra.run.trial198.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-17T00:23:40.350 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-17T00:23:40.364 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-17T00:23:40.364 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:40.364 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T00:23:40.365 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:41.078 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-17T00:23:41.103 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-17T00:23:41.103 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:41.103 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T00:23:41.103 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T00:23:41.103 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T00:23:41.104 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:41.162 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-17T00:23:41.163 INFO:teuthology.orchestra.run.trial198.stdout: Installing : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-17T00:23:41.168 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 87/98 2026-02-17T00:23:41.188 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 88/98 2026-02-17T00:23:41.189 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-17T00:23:41.683 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-17T00:23:41.686 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-17T00:23:42.144 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-17T00:23:42.145 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-17T00:23:42.158 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-17T00:23:42.158 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-17T00:23:42.213 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-17T00:23:42.264 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 93/98 2026-02-17T00:23:42.265 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-17T00:23:42.287 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-17T00:23:42.287 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:42.287 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T00:23:42.287 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T00:23:42.287 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T00:23:42.287 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:42.298 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-17T00:23:42.523 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-17T00:23:42.524 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-17T00:23:42.546 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-17T00:23:42.546 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:42.546 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T00:23:42.547 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T00:23:42.547 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T00:23:42.547 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:42.651 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-17T00:23:42.672 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-17T00:23:42.672 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:42.672 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T00:23:42.672 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T00:23:42.673 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T00:23:42.673 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:42.690 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 1/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 3/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 4/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 5/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 6/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 7/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 8/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 9/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 10/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 11/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 12/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 13/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 14/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 15/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-17T00:23:43.340 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-17T00:23:43.341 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-17T00:23:43.342 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-17T00:23:43.409 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-17T00:23:43.409 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:43.409 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:43.409 INFO:teuthology.orchestra.run.trial198.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T00:23:43.409 INFO:teuthology.orchestra.run.trial198.stdout: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:43.409 INFO:teuthology.orchestra.run.trial198.stdout: ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:43.410 INFO:teuthology.orchestra.run.trial198.stdout: ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T00:23:43.411 INFO:teuthology.orchestra.run.trial198.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T00:23:43.412 INFO:teuthology.orchestra.run.trial198.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T00:23:43.413 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T00:23:43.414 INFO:teuthology.orchestra.run.trial198.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T00:23:43.415 INFO:teuthology.orchestra.run.trial198.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T00:23:43.416 INFO:teuthology.orchestra.run.trial198.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T00:23:43.417 INFO:teuthology.orchestra.run.trial198.stdout: zip-3.0-35.el9.x86_64 2026-02-17T00:23:43.418 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:43.418 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:43.465 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-base 2026-02-17T00:23:43.778 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:43.842 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:43.859 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:43.860 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:43.860 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:43.881 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install cephadm 2026-02-17T00:23:44.191 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:44.255 INFO:teuthology.orchestra.run.trial198.stdout:Package cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-17T00:23:44.273 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:44.274 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:44.274 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:44.294 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T00:23:44.604 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:44.686 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:44.686 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:44.686 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-680.g05b55d19.el9 ceph 145 k 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 145 k 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 431 k 2026-02-17T00:23:44.687 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:44.773 INFO:teuthology.orchestra.run.trial198.stdout:ceph-immutable-object-cache-19.2.3-680.g05b55d1 1.7 MB/s | 145 kB 00:00 2026-02-17T00:23:44.773 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:44.773 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T00:23:44.773 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:44.776 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:44.776 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:44.808 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:44.808 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:44.863 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:44.864 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-17T00:23:44.888 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-17T00:23:44.888 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:44.889 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T00:23:44.889 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:45.173 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-17T00:23:45.173 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:45.173 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:45.173 INFO:teuthology.orchestra.run.trial198.stdout: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:45.173 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:45.174 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:45.200 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr 2026-02-17T00:23:45.514 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:45.578 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:45.595 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:45.596 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:45.596 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:45.616 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T00:23:45.929 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:45.994 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-17T00:23:46.011 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:46.011 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:46.011 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:46.032 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T00:23:46.342 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:46.406 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-17T00:23:46.423 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:46.424 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:46.424 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:46.445 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-rook 2026-02-17T00:23:46.756 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:46.822 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-17T00:23:46.839 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:46.839 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:46.839 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:46.861 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T00:23:47.169 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:47.236 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-17T00:23:47.254 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:47.254 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:47.254 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:47.275 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-fuse 2026-02-17T00:23:47.586 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:47.668 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout: ceph-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.2 M 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 1.2 M 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 3.6 M 2026-02-17T00:23:47.669 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:47.789 INFO:teuthology.orchestra.run.trial198.stdout:ceph-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 9.6 MB/s | 1.2 MB 00:00 2026-02-17T00:23:47.790 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:47.790 INFO:teuthology.orchestra.run.trial198.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-17T00:23:47.790 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:47.793 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:47.793 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:47.828 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:47.828 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:47.931 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:47.948 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:48.200 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:48.258 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:48.258 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:48.258 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:48.259 INFO:teuthology.orchestra.run.trial198.stdout: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:48.259 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:48.259 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:48.288 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-volume 2026-02-17T00:23:48.599 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:48.664 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-17T00:23:48.682 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:48.683 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:48.683 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:48.704 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install librados-devel 2026-02-17T00:23:49.014 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:49.097 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:49.097 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:49.097 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T00:23:49.098 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:49.098 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:49.098 INFO:teuthology.orchestra.run.trial198.stdout: librados-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 126 k 2026-02-17T00:23:49.098 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:49.098 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:49.098 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:49.099 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T00:23:49.099 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:49.099 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 126 k 2026-02-17T00:23:49.099 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 456 k 2026-02-17T00:23:49.099 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:49.182 INFO:teuthology.orchestra.run.trial198.stdout:librados-devel-19.2.3-680.g05b55d19.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-17T00:23:49.182 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:49.183 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T00:23:49.183 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:49.185 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:49.185 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:49.217 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:49.217 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:49.272 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:49.289 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:49.366 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:49.424 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:49.424 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:49.424 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:49.424 INFO:teuthology.orchestra.run.trial198.stdout: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:49.424 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:49.424 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:49.456 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install libcephfs2 2026-02-17T00:23:49.771 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:49.836 INFO:teuthology.orchestra.run.trial198.stdout:Package libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:49.854 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:49.854 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:49.854 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:49.878 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install libcephfs-devel 2026-02-17T00:23:50.190 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:50.274 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 34 k 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 34 k 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 153 k 2026-02-17T00:23:50.275 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:50.349 INFO:teuthology.orchestra.run.trial198.stdout:libcephfs-devel-19.2.3-680.g05b55d19.el9.x86_64 455 kB/s | 34 kB 00:00 2026-02-17T00:23:50.349 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:50.349 INFO:teuthology.orchestra.run.trial198.stdout:Total 450 kB/s | 34 kB 00:00 2026-02-17T00:23:50.350 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:50.351 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:50.351 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:50.353 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:50.353 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:50.374 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:50.390 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:50.445 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:50.503 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:50.503 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:50.503 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:50.503 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:50.503 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:50.503 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:50.533 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install librados2 2026-02-17T00:23:50.846 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:50.911 INFO:teuthology.orchestra.run.trial198.stdout:Package librados2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:50.928 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:50.929 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:50.929 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:50.951 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install librbd1 2026-02-17T00:23:51.261 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:51.325 INFO:teuthology.orchestra.run.trial198.stdout:Package librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:51.342 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:51.343 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:51.343 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:51.365 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-rados 2026-02-17T00:23:51.676 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:51.741 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:51.758 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:51.759 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:51.759 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:51.781 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-rgw 2026-02-17T00:23:52.091 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:52.157 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:52.175 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:52.175 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:52.176 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:52.197 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-cephfs 2026-02-17T00:23:52.500 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:52.565 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:52.582 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:52.583 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:52.583 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:52.604 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-rbd 2026-02-17T00:23:52.917 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:52.983 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-17T00:23:53.000 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:53.001 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T00:23:53.001 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:53.022 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install rbd-fuse 2026-02-17T00:23:53.330 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:53.412 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:53.412 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout: rbd-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 85 k 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 85 k 2026-02-17T00:23:53.413 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 227 k 2026-02-17T00:23:53.414 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:53.733 INFO:teuthology.orchestra.run.trial198.stdout:rbd-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 266 kB/s | 85 kB 00:00 2026-02-17T00:23:53.733 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:53.734 INFO:teuthology.orchestra.run.trial198.stdout:Total 265 kB/s | 85 kB 00:00 2026-02-17T00:23:53.734 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:53.737 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:53.737 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:53.771 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:53.771 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:53.824 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:53.840 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:53.924 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:53.982 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:53.982 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:53.982 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:53.983 INFO:teuthology.orchestra.run.trial198.stdout: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:53.983 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:53.983 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:54.011 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install rbd-mirror 2026-02-17T00:23:54.336 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:54.419 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:54.419 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:54.419 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T00:23:54.419 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:54.419 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:54.419 INFO:teuthology.orchestra.run.trial198.stdout: rbd-mirror x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.1 M 2026-02-17T00:23:54.419 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:54.420 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:54.420 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:54.420 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T00:23:54.420 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:54.420 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 3.1 M 2026-02-17T00:23:54.420 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 13 M 2026-02-17T00:23:54.420 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:54.889 INFO:teuthology.orchestra.run.trial198.stdout:rbd-mirror-19.2.3-680.g05b55d19.el9.x86_64.rpm 6.6 MB/s | 3.1 MB 00:00 2026-02-17T00:23:54.889 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:54.889 INFO:teuthology.orchestra.run.trial198.stdout:Total 6.6 MB/s | 3.1 MB 00:00 2026-02-17T00:23:54.890 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:54.893 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:54.893 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:54.934 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:54.934 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:55.124 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:55.125 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:55.148 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:55.148 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:23:55.148 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T00:23:55.148 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T00:23:55.148 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T00:23:55.149 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:55.480 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:55.480 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:55.480 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:55.480 INFO:teuthology.orchestra.run.trial198.stdout: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:55.480 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:55.480 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:55.509 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install rbd-nbd 2026-02-17T00:23:55.819 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:23:55.903 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T00:23:55.903 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:55.903 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T00:23:55.903 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:55.903 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T00:23:55.903 INFO:teuthology.orchestra.run.trial198.stdout: rbd-nbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 170 k 2026-02-17T00:23:55.903 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:55.904 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T00:23:55.904 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T00:23:55.904 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T00:23:55.904 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:55.904 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 170 k 2026-02-17T00:23:55.904 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 490 k 2026-02-17T00:23:55.904 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T00:23:55.990 INFO:teuthology.orchestra.run.trial198.stdout:rbd-nbd-19.2.3-680.g05b55d19.el9.x86_64.rpm 1.9 MB/s | 170 kB 00:00 2026-02-17T00:23:55.991 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:23:55.991 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-17T00:23:55.991 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T00:23:55.994 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T00:23:55.994 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T00:23:56.026 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T00:23:56.026 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T00:23:56.081 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T00:23:56.098 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:56.179 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:56.237 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-17T00:23:56.237 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:56.237 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T00:23:56.237 INFO:teuthology.orchestra.run.trial198.stdout: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-17T00:23:56.238 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:23:56.238 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T00:23:56.269 DEBUG:teuthology.parallel:result is None 2026-02-17T00:23:56.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:23:56.419 DEBUG:teuthology.orchestra.run.trial198:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T00:23:56.440 INFO:teuthology.orchestra.run.trial198.stdout:19.2.3-680.g05b55d19.el9 2026-02-17T00:23:56.441 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-680.g05b55d19.el9 2026-02-17T00:23:56.441 INFO:teuthology.task.install:The correct ceph version 19.2.3-680.g05b55d19 is installed. 2026-02-17T00:23:56.443 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T00:23:56.443 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:23:56.443 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T00:23:56.505 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T00:23:56.505 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:23:56.505 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T00:23:56.570 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T00:23:56.634 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T00:23:56.635 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:23:56.635 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T00:23:56.700 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T00:23:56.765 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T00:23:56.765 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:23:56.765 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T00:23:56.830 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T00:23:56.895 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-17T00:23:57.026 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'CEPHADM_FAILED_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'} 2026-02-17T00:23:57.026 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:23:57.030 INFO:tasks.cephadm:Cluster fsid is f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:23:57.030 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-17T00:23:57.030 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.198'} 2026-02-17T00:23:57.030 INFO:tasks.cephadm:First mon is mon.a on trial198 2026-02-17T00:23:57.030 INFO:tasks.cephadm:First mgr is a 2026-02-17T00:23:57.030 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-17T00:23:57.030 DEBUG:teuthology.orchestra.run.trial198:> sudo hostname $(hostname -s) 2026-02-17T00:23:57.056 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-17T00:23:57.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:23:57.183 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'ref': 'wip-squid-pr-67199-kefu-1', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-08 09:09:39.435166', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-680-g05b55d19', 'package_manager_version': '19.2.3-680.g05b55d19', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2857/', 'root_build_cause': '', 'node_name': '10.20.192.93+toko03', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-17T00:23:57.368 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-squid-pr-67199-kefu-1, sha1 05b55d192f002ad5df41409624b8d176527d0841 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:23:57.370 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-17T00:23:57.370 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-17T00:23:57.370 DEBUG:teuthology.orchestra.run.trial198:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T00:23:57.626 INFO:teuthology.orchestra.run.trial198.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 17 00:23 /home/ubuntu/cephtest/cephadm 2026-02-17T00:23:57.626 DEBUG:teuthology.orchestra.run.trial198:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T00:23:57.657 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 on all hosts... 2026-02-17T00:23:57.657 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-17T00:23:57.839 INFO:teuthology.orchestra.run.trial198.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-17T00:24:05.910 INFO:teuthology.orchestra.run.trial198.stdout:{ 2026-02-17T00:24:05.910 INFO:teuthology.orchestra.run.trial198.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-17T00:24:05.910 INFO:teuthology.orchestra.run.trial198.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-17T00:24:05.911 INFO:teuthology.orchestra.run.trial198.stdout: "repo_digests": [ 2026-02-17T00:24:05.911 INFO:teuthology.orchestra.run.trial198.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-17T00:24:05.911 INFO:teuthology.orchestra.run.trial198.stdout: ] 2026-02-17T00:24:05.911 INFO:teuthology.orchestra.run.trial198.stdout:} 2026-02-17T00:24:05.926 DEBUG:teuthology.orchestra.run.trial198:> sudo mkdir -p /etc/ceph 2026-02-17T00:24:05.984 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod 777 /etc/ceph 2026-02-17T00:24:06.009 INFO:tasks.cephadm:Writing seed config... 2026-02-17T00:24:06.011 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2026-02-17T00:24:06.011 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-17T00:24:06.012 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-17T00:24:06.012 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2026-02-17T00:24:06.012 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-17T00:24:06.012 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-17T00:24:06.012 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-17T00:24:06.012 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-17T00:24:06.012 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-17T00:24:06.013 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:06.013 DEBUG:teuthology.orchestra.run.trial198:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T00:24:06.066 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f2b6e4ff-0b96-11f1-955f-d404e6e7d460 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-17T00:24:06.066 DEBUG:teuthology.orchestra.run.trial198:mon.a> sudo journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service 2026-02-17T00:24:06.108 DEBUG:teuthology.orchestra.run.trial198:mgr.a> sudo journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a.service 2026-02-17T00:24:06.152 INFO:tasks.cephadm:Bootstrapping... 2026-02-17T00:24:06.152 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 -v bootstrap --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.198 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:24:06.288 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:24:06.289 INFO:teuthology.orchestra.run.trial198.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841', '-v', 'bootstrap', '--fsid', 'f2b6e4ff-0b96-11f1-955f-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.198', '--skip-admin-label'] 2026-02-17T00:24:06.289 INFO:teuthology.orchestra.run.trial198.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-17T00:24:06.289 INFO:teuthology.orchestra.run.trial198.stdout:Verifying podman|docker is present... 2026-02-17T00:24:06.304 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stdout 5.6.0 2026-02-17T00:24:06.305 INFO:teuthology.orchestra.run.trial198.stdout:Verifying lvm2 is present... 2026-02-17T00:24:06.305 INFO:teuthology.orchestra.run.trial198.stdout:Verifying time synchronization is in place... 2026-02-17T00:24:06.311 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T00:24:06.311 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T00:24:06.317 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T00:24:06.317 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout inactive 2026-02-17T00:24:06.323 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout enabled 2026-02-17T00:24:06.328 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout active 2026-02-17T00:24:06.329 INFO:teuthology.orchestra.run.trial198.stdout:Unit chronyd.service is enabled and running 2026-02-17T00:24:06.329 INFO:teuthology.orchestra.run.trial198.stdout:Repeating the final host check... 2026-02-17T00:24:06.344 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stdout 5.6.0 2026-02-17T00:24:06.344 INFO:teuthology.orchestra.run.trial198.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-17T00:24:06.344 INFO:teuthology.orchestra.run.trial198.stdout:systemctl is present 2026-02-17T00:24:06.345 INFO:teuthology.orchestra.run.trial198.stdout:lvcreate is present 2026-02-17T00:24:06.350 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T00:24:06.350 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T00:24:06.356 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T00:24:06.356 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout inactive 2026-02-17T00:24:06.362 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout enabled 2026-02-17T00:24:06.367 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout active 2026-02-17T00:24:06.368 INFO:teuthology.orchestra.run.trial198.stdout:Unit chronyd.service is enabled and running 2026-02-17T00:24:06.368 INFO:teuthology.orchestra.run.trial198.stdout:Host looks OK 2026-02-17T00:24:06.368 INFO:teuthology.orchestra.run.trial198.stdout:Cluster fsid: f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:06.368 INFO:teuthology.orchestra.run.trial198.stdout:Acquiring lock 140051718986240 on /run/cephadm/f2b6e4ff-0b96-11f1-955f-d404e6e7d460.lock 2026-02-17T00:24:06.368 INFO:teuthology.orchestra.run.trial198.stdout:Lock 140051718986240 acquired on /run/cephadm/f2b6e4ff-0b96-11f1-955f-d404e6e7d460.lock 2026-02-17T00:24:06.368 INFO:teuthology.orchestra.run.trial198.stdout:Verifying IP 10.20.193.198 port 3300 ... 2026-02-17T00:24:06.368 INFO:teuthology.orchestra.run.trial198.stdout:Verifying IP 10.20.193.198 port 6789 ... 2026-02-17T00:24:06.369 INFO:teuthology.orchestra.run.trial198.stdout:Base mon IP(s) is [10.20.193.198:3300, 10.20.193.198:6789], mon addrv is [v2:10.20.193.198:3300,v1:10.20.193.198:6789] 2026-02-17T00:24:06.372 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.198 metric 102 2026-02-17T00:24:06.372 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.198 metric 102 2026-02-17T00:24:06.372 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T00:24:06.374 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-17T00:24:06.374 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-17T00:24:06.375 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout inet6 fe80::4054:4be7:f2f:35fc/64 scope link noprefixroute 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6332/64 scope link 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:Mon IP `10.20.193.198` is in CIDR network `10.20.192.0/20` 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:Mon IP `10.20.193.198` is in CIDR network `10.20.192.0/20` 2026-02-17T00:24:06.378 INFO:teuthology.orchestra.run.trial198.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-17T00:24:06.379 INFO:teuthology.orchestra.run.trial198.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-17T00:24:06.379 INFO:teuthology.orchestra.run.trial198.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-17T00:24:06.618 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stdout dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-17T00:24:06.618 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-17T00:24:06.618 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stderr Getting image source signatures 2026-02-17T00:24:06.618 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stderr Copying blob sha256:a10ade7902ac0ef76ec881f51088d9f38168c6983473ae266a7fda42a3d99f76 2026-02-17T00:24:06.619 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stderr Copying blob sha256:c92ccfe8c151fb35c12ff15a7a7de08028e120d73814d436eadc192e84f49ad9 2026-02-17T00:24:06.619 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stderr Copying config sha256:dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-17T00:24:06.619 INFO:teuthology.orchestra.run.trial198.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-17T00:24:06.737 INFO:teuthology.orchestra.run.trial198.stdout:ceph: stdout ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-17T00:24:06.738 INFO:teuthology.orchestra.run.trial198.stdout:Ceph version: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-17T00:24:06.738 INFO:teuthology.orchestra.run.trial198.stdout:Extracting ceph user uid/gid from container image... 2026-02-17T00:24:06.855 INFO:teuthology.orchestra.run.trial198.stdout:stat: stdout 167 167 2026-02-17T00:24:06.856 INFO:teuthology.orchestra.run.trial198.stdout:Creating initial keys... 2026-02-17T00:24:06.980 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph-authtool: stdout AQAmtZNpedSNORAAKZXUFz6Ol87GZBvS7BPuQg== 2026-02-17T00:24:07.114 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph-authtool: stdout AQAntZNpQLHXBBAAAm3m+YKE0g6uwHCww6HpSQ== 2026-02-17T00:24:07.235 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph-authtool: stdout AQAntZNpIEUaDRAA1LaHS80gdsCIpjvGjDHo2A== 2026-02-17T00:24:07.235 INFO:teuthology.orchestra.run.trial198.stdout:Creating initial monmap... 2026-02-17T00:24:07.377 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T00:24:07.377 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-17T00:24:07.377 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:07.377 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T00:24:07.377 INFO:teuthology.orchestra.run.trial198.stdout:monmaptool for a [v2:10.20.193.198:3300,v1:10.20.193.198:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T00:24:07.377 INFO:teuthology.orchestra.run.trial198.stdout:setting min_mon_release = quincy 2026-02-17T00:24:07.377 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/monmaptool: set fsid to f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:07.378 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T00:24:07.378 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:07.378 INFO:teuthology.orchestra.run.trial198.stdout:Creating mon... 2026-02-17T00:24:07.496 INFO:teuthology.orchestra.run.trial198.stdout:create mon.a on 2026-02-17T00:24:07.677 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-17T00:24:07.780 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-17T00:24:07.888 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460.target → /etc/systemd/system/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460.target. 2026-02-17T00:24:07.888 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460.target → /etc/systemd/system/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460.target. 2026-02-17T00:24:08.024 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a 2026-02-17T00:24:08.024 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service: Unit ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service not loaded. 2026-02-17T00:24:08.148 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460.target.wants/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@.service. 2026-02-17T00:24:08.283 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 podman[38935]: 2026-02-17 00:24:08.280012643 +0000 UTC m=+0.048119083 container start b8c81350cc05330a2a78af0d61410ccf52bbc07f8fe9c76c2192c0f0d5ecaa5a (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2026-02-17T00:24:08.296 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:24:08.297 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout disabled 2026-02-17T00:24:08.303 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:24:08.303 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout inactive 2026-02-17T00:24:08.303 INFO:teuthology.orchestra.run.trial198.stdout:firewalld.service is not enabled 2026-02-17T00:24:08.303 INFO:teuthology.orchestra.run.trial198.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T00:24:08.304 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for mon to start... 2026-02-17T00:24:08.304 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for mon... 2026-02-17T00:24:08.463 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout cluster: 2026-02-17T00:24:08.463 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout id: f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:08.463 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout services: 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.135489s) 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout data: 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-17T00:24:08.464 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout pgs: 2026-02-17T00:24:08.465 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:08.465 INFO:teuthology.orchestra.run.trial198.stdout:mon is available 2026-02-17T00:24:08.465 INFO:teuthology.orchestra.run.trial198.stdout:Assimilating anything we can from ceph.conf... 2026-02-17T00:24:08.577 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 bash[38935]: b8c81350cc05330a2a78af0d61410ccf52bbc07f8fe9c76c2192c0f0d5ecaa5a 2026-02-17T00:24:08.577 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 podman[38935]: 2026-02-17 00:24:08.241765544 +0000 UTC m=+0.009871994 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:24:08.577 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 systemd[1]: Started Ceph mon.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:24:08.577 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 ceph-mon[38963]: mkfs f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:08.577 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 ceph-mon[38963]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout fsid = f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.198:3300,v1:10.20.193.198:6789] 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T00:24:08.609 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = True 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T00:24:08.610 INFO:teuthology.orchestra.run.trial198.stdout:Generating new minimal ceph.conf... 2026-02-17T00:24:08.768 INFO:teuthology.orchestra.run.trial198.stdout:Restarting the monitor... 2026-02-17T00:24:08.857 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 systemd[1]: Stopping Ceph mon.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460... 2026-02-17T00:24:09.107 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a[38956]: 2026-02-17T00:24:08.851+0000 7f7546c09640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:24:09.107 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:08 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a[38956]: 2026-02-17T00:24:08.851+0000 7f7546c09640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T00:24:09.107 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 podman[39243]: 2026-02-17 00:24:09.096048945 +0000 UTC m=+0.255671249 container died b8c81350cc05330a2a78af0d61410ccf52bbc07f8fe9c76c2192c0f0d5ecaa5a (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260202, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T00:24:09.107 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 podman[39243]: 2026-02-17 00:24:09.104087443 +0000 UTC m=+0.263709737 container remove b8c81350cc05330a2a78af0d61410ccf52bbc07f8fe9c76c2192c0f0d5ecaa5a (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.build-date=20260202, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T00:24:09.294 INFO:teuthology.orchestra.run.trial198.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-17T00:24:09.367 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 bash[39243]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 systemd[1]: Stopped Ceph mon.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 systemd[1]: Starting Ceph mon.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460... 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 podman[39372]: 2026-02-17 00:24:09.255846705 +0000 UTC m=+0.014846122 container create e4b71ca592a01f993870a3841c51ebc88b094a9163c7f7cf76a72215873152df (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.build-date=20260202, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 podman[39372]: 2026-02-17 00:24:09.284749681 +0000 UTC m=+0.043749108 container init e4b71ca592a01f993870a3841c51ebc88b094a9163c7f7cf76a72215873152df (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_REF=wip-squid-pr-67199-kefu-1, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.build-date=20260202) 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 podman[39372]: 2026-02-17 00:24:09.287007884 +0000 UTC m=+0.046007312 container start e4b71ca592a01f993870a3841c51ebc88b094a9163c7f7cf76a72215873152df (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.build-date=20260202, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 bash[39372]: e4b71ca592a01f993870a3841c51ebc88b094a9163c7f7cf76a72215873152df 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 podman[39372]: 2026-02-17 00:24:09.249889903 +0000 UTC m=+0.008889340 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 systemd[1]: Started Ceph mon.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: set uid:gid to 167:167 (ceph:ceph) 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable), process ceph-mon, pid 2 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: pidfile_write: ignore empty --pid-file 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: load: jerasure load: lrc 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: RocksDB version: 7.9.2 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Git sha 0 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Compile date 2026-02-08 08:28:36 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: DB SUMMARY 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: DB Session ID: Z1F83X3Z4YHYCJOYWYBW 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: CURRENT file: CURRENT 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: IDENTITY file: IDENTITY 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 74989 ; 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.error_if_exists: 0 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.create_if_missing: 0 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.paranoid_checks: 1 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.env: 0x55a9043fcdc0 2026-02-17T00:24:09.368 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.fs: PosixFileSystem 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.info_log: 0x55a904ed7880 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_file_opening_threads: 16 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.statistics: (nil) 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.use_fsync: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_log_file_size: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.keep_log_file_num: 1000 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.recycle_log_file_num: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.allow_fallocate: 1 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.allow_mmap_reads: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.allow_mmap_writes: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.use_direct_reads: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.create_missing_column_families: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.db_log_dir: 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.wal_dir: 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.advise_random_on_open: 1 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.db_write_buffer_size: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.write_buffer_manager: 0x55a904edb900 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.rate_limiter: (nil) 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.wal_recovery_mode: 2 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.enable_thread_tracking: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.enable_pipelined_write: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.unordered_write: 0 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-17T00:24:09.369 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.row_cache: None 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.wal_filter: None 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.allow_ingest_behind: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.two_write_queues: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.manual_wal_flush: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.wal_compression: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.atomic_flush: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.log_readahead_size: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.best_efforts_recovery: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.allow_data_in_errors: 0 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.db_host_id: __hostname__ 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_background_jobs: 2 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_background_compactions: -1 2026-02-17T00:24:09.370 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_subcompactions: 1 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_total_wal_size: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_open_files: -1 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bytes_per_sync: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_readahead_size: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_background_flushes: -1 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Compression algorithms supported: 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kZSTD supported: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kXpressCompression supported: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kBZip2Compression supported: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kLZ4Compression supported: 1 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kZlibCompression supported: 1 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kLZ4HCCompression supported: 1 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: kSnappyCompression supported: 1 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.merge_operator: 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_filter: None 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_filter_factory: None 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.sst_partitioner_factory: None 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-17T00:24:09.371 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a904ed6480) 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: cache_index_and_filter_blocks: 1 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: pin_top_level_index_and_filter: 1 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: index_type: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: data_block_index_type: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: index_shortening: 1 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: checksum: 4 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: no_block_cache: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_cache: 0x55a904efb350 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_cache_name: BinnedLRUCache 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_cache_options: 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: capacity : 536870912 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: num_shard_bits : 4 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: strict_capacity_limit : 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: high_pri_pool_ratio: 0.000 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_cache_compressed: (nil) 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: persistent_cache: (nil) 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_size: 4096 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_size_deviation: 10 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_restart_interval: 16 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: index_block_restart_interval: 1 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: metadata_block_size: 4096 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: partition_filters: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: use_delta_encoding: 1 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: filter_policy: bloomfilter 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: whole_key_filtering: 1 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: verify_compression: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: read_amp_bytes_per_bit: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: format_version: 5 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: enable_index_compression: 1 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: block_align: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: max_auto_readahead_size: 262144 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: prepopulate_block_cache: 0 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: initial_auto_readahead_size: 8192 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout: num_file_reads_for_auto_readahead: 2 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.write_buffer_size: 33554432 2026-02-17T00:24:09.372 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_write_buffer_number: 2 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression: NoCompression 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression: Disabled 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.prefix_extractor: nullptr 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.num_levels: 7 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.level: 32767 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.strategy: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.enabled: false 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.target_file_size_base: 67108864 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-17T00:24:09.373 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.arena_block_size: 1048576 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.disable_auto_compactions: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.inplace_update_support: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.bloom_locality: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.max_successive_merges: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.paranoid_file_checks: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.force_consistency_checks: 1 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.report_bg_io_stats: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.ttl: 2592000 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-17T00:24:09.374 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.enable_blob_files: false 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.min_blob_size: 0 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.blob_file_size: 268435456 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.blob_file_starting_level: 0 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d79ae73f-f75c-4847-99d1-b5a1412f5f04 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771287849306096, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771287849307862, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 72130, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 223, "table_properties": {"data_size": 70401, "index_size": 178, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9550, "raw_average_key_size": 49, "raw_value_size": 64973, "raw_average_value_size": 334, "num_data_blocks": 8, "num_entries": 194, "num_filter_entries": 194, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771287849, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d79ae73f-f75c-4847-99d1-b5a1412f5f04", "db_session_id": "Z1F83X3Z4YHYCJOYWYBW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771287849307926, "job": 1, "event": "recovery_finished"} 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a904efce00 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: DB pointer 0x55a905006000 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: ** DB Stats ** 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: ** Compaction Stats [default] ** 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: L0 2/0 72.30 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Sum 2/0 72.30 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-17T00:24:09.375 INFO:journalctl@ceph.mon.a.trial198.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 45.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: ** Compaction Stats [default] ** 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 45.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Cumulative compaction: 0.00 GB write, 17.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Interval compaction: 0.00 GB write, 17.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Block cache BinnedLRUCache@0x55a904efb350#2 capacity: 512.00 MB usage: 1.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.70 KB,0.00013411%) IndexBlock(2,0.38 KB,7.15256e-05%) Misc(1,0.00 KB,0%) 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: starting mon.a rank 0 at public addrs [v2:10.20.193.198:3300/0,v1:10.20.193.198:6789/0] at bind addrs [v2:10.20.193.198:3300/0,v1:10.20.193.198:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???) e1 preinit fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???).mds e1 new map 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???).mds e1 print_map 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: e1 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: btime 2026-02-17T00:24:08:304973+0000 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: legacy client fscid: -1 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout: No filesystems configured 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-17T00:24:09.376 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: monmap epoch 1 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: last_changed 2026-02-17T00:24:07.344652+0000 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: created 2026-02-17T00:24:07.344652+0000 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: min_mon_release 19 (squid) 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: election_strategy: 1 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: 0: [v2:10.20.193.198:3300/0,v1:10.20.193.198:6789/0] mon.a 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: fsmap 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: osdmap e1: 0 total, 0 up, 0 in 2026-02-17T00:24:09.377 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:09 trial198 ceph-mon[39397]: mgrmap e1: no daemons active 2026-02-17T00:24:09.456 INFO:teuthology.orchestra.run.trial198.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-17T00:24:09.456 INFO:teuthology.orchestra.run.trial198.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:24:09.457 INFO:teuthology.orchestra.run.trial198.stdout:Creating mgr... 2026-02-17T00:24:09.457 INFO:teuthology.orchestra.run.trial198.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-17T00:24:09.457 INFO:teuthology.orchestra.run.trial198.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-17T00:24:09.589 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a 2026-02-17T00:24:09.589 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a.service: Unit ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a.service not loaded. 2026-02-17T00:24:09.705 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460.target.wants/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@.service. 2026-02-17T00:24:09.843 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:24:09.843 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout disabled 2026-02-17T00:24:09.849 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:24:09.849 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout inactive 2026-02-17T00:24:09.849 INFO:teuthology.orchestra.run.trial198.stdout:firewalld.service is not enabled 2026-02-17T00:24:09.849 INFO:teuthology.orchestra.run.trial198.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T00:24:09.856 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:24:09.856 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout disabled 2026-02-17T00:24:09.862 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:24:09.862 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout inactive 2026-02-17T00:24:09.862 INFO:teuthology.orchestra.run.trial198.stdout:firewalld.service is not enabled 2026-02-17T00:24:09.862 INFO:teuthology.orchestra.run.trial198.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-17T00:24:09.862 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for mgr to start... 2026-02-17T00:24:09.862 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for mgr... 2026-02-17T00:24:10.020 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:10.020 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:24:10.020 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "fsid": "f2b6e4ff-0b96-11f1-955f-d404e6e7d460", 2026-02-17T00:24:10.020 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T00:24:10.020 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 0 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T00:24:10.021 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T00:24:10.022 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T00:24:10.023 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T00:24:08:304973+0000", 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T00:24:10.024 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T00:24:08.305430+0000", 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:24:10.025 INFO:teuthology.orchestra.run.trial198.stdout:mgr not available, waiting (1/15)... 2026-02-17T00:24:10.353 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.206+0000 7f29a0302140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T00:24:10.353 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.347+0000 7f29a0302140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T00:24:10.622 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1949023103' entity='client.admin' 2026-02-17T00:24:10.622 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2787235229' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.381+0000 7f29a0302140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.421+0000 7f29a0302140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.451+0000 7f29a0302140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.484+0000 7f29a0302140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.548+0000 7f29a0302140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T00:24:10.623 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: from numpy import show_config as show_numpy_config 2026-02-17T00:24:10.872 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.620+0000 7f29a0302140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T00:24:10.873 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.653+0000 7f29a0302140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T00:24:10.873 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.747+0000 7f29a0302140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T00:24:10.873 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.803+0000 7f29a0302140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T00:24:10.873 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.836+0000 7f29a0302140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T00:24:10.873 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.867+0000 7f29a0302140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T00:24:11.171 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.900+0000 7f29a0302140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T00:24:11.171 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:10 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:10.930+0000 7f29a0302140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T00:24:11.171 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.166+0000 7f29a0302140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T00:24:11.447 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.263+0000 7f29a0302140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T00:24:11.447 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.292+0000 7f29a0302140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T00:24:11.447 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.322+0000 7f29a0302140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T00:24:11.447 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.414+0000 7f29a0302140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T00:24:11.447 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.442+0000 7f29a0302140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T00:24:11.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.532+0000 7f29a0302140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T00:24:12.171 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "fsid": "f2b6e4ff-0b96-11f1-955f-d404e6e7d460", 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:12.172 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 0 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T00:24:12.173 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T00:24:12.174 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T00:24:08:304973+0000", 2026-02-17T00:24:12.175 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:12.176 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T00:24:12.177 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:12.177 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T00:24:08.305430+0000", 2026-02-17T00:24:12.177 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:24:12.177 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:12.177 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T00:24:12.177 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:24:12.177 INFO:teuthology.orchestra.run.trial198.stdout:mgr not available, waiting (2/15)... 2026-02-17T00:24:12.420 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:12 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3880515384' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T00:24:12.420 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:11.988+0000 7f29a0302140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T00:24:12.420 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:12 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:12.018+0000 7f29a0302140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T00:24:12.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:12 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:12.414+0000 7f29a0302140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T00:24:13.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: Activating manager daemon a 2026-02-17T00:24:13.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: mgrmap e2: a(active, starting, since 0.00272031s) 2026-02-17T00:24:13.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T00:24:13.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T00:24:13.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T00:24:13.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T00:24:13.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T00:24:13.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: Manager daemon a is now available 2026-02-17T00:24:13.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T00:24:13.458 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T00:24:13.458 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' 2026-02-17T00:24:13.458 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' 2026-02-17T00:24:13.458 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:13 trial198 ceph-mon[39397]: from='mgr.14100 10.20.193.198:0/43544046' entity='mgr.a' 2026-02-17T00:24:14.423 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:14.423 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:24:14.423 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "fsid": "f2b6e4ff-0b96-11f1-955f-d404e6e7d460", 2026-02-17T00:24:14.423 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T00:24:14.423 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T00:24:14.423 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 0 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-17T00:24:14.424 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T00:24:14.425 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:14.426 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T00:24:08:304973+0000", 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:24:14.427 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T00:24:08.305430+0000", 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:24:14.428 INFO:teuthology.orchestra.run.trial198.stdout:mgr is available 2026-02-17T00:24:14.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:14 trial198 ceph-mon[39397]: mgrmap e3: a(active, since 1.00463s) 2026-02-17T00:24:14.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:14 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1385965875' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T00:24:14.633 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout fsid = f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.198:3300,v1:10.20.193.198:6789] 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:14.634 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T00:24:14.635 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T00:24:14.635 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 2026-02-17T00:24:14.635 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T00:24:14.635 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T00:24:14.635 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T00:24:14.635 INFO:teuthology.orchestra.run.trial198.stdout:Enabling cephadm module... 2026-02-17T00:24:15.680 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:15 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: ignoring --setuser ceph since I am not root 2026-02-17T00:24:15.680 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:15 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: ignoring --setgroup ceph since I am not root 2026-02-17T00:24:15.681 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:15 trial198 ceph-mon[39397]: mgrmap e4: a(active, since 2s) 2026-02-17T00:24:15.681 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:15 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3821119074' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-17T00:24:15.681 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:15 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3821119074' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-17T00:24:15.681 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:15 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2696219070' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-17T00:24:15.869 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:24:15.869 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-17T00:24:15.869 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T00:24:15.869 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T00:24:15.869 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T00:24:15.869 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:24:15.870 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for the mgr to restart... 2026-02-17T00:24:15.870 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for mgr epoch 5... 2026-02-17T00:24:16.242 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.022+0000 7efc80b5e140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T00:24:16.242 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.164+0000 7efc80b5e140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T00:24:16.242 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.197+0000 7efc80b5e140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T00:24:16.242 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.237+0000 7efc80b5e140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T00:24:16.567 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.267+0000 7efc80b5e140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T00:24:16.567 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.301+0000 7efc80b5e140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T00:24:16.568 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.365+0000 7efc80b5e140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T00:24:16.568 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T00:24:16.568 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T00:24:16.568 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: from numpy import show_config as show_numpy_config 2026-02-17T00:24:16.568 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.436+0000 7efc80b5e140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T00:24:16.568 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.469+0000 7efc80b5e140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T00:24:16.568 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.563+0000 7efc80b5e140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T00:24:16.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2696219070' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-17T00:24:16.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-mon[39397]: mgrmap e5: a(active, since 3s) 2026-02-17T00:24:16.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2440850904' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T00:24:16.957 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.620+0000 7efc80b5e140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T00:24:16.957 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.653+0000 7efc80b5e140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T00:24:16.957 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.685+0000 7efc80b5e140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T00:24:16.957 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.718+0000 7efc80b5e140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T00:24:16.958 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.748+0000 7efc80b5e140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T00:24:17.235 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:16 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:16.980+0000 7efc80b5e140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T00:24:17.236 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.079+0000 7efc80b5e140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T00:24:17.236 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.109+0000 7efc80b5e140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T00:24:17.236 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.139+0000 7efc80b5e140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T00:24:17.236 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.231+0000 7efc80b5e140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T00:24:17.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.259+0000 7efc80b5e140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T00:24:17.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.351+0000 7efc80b5e140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T00:24:18.206 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.813+0000 7efc80b5e140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T00:24:18.206 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:17 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:17.842+0000 7efc80b5e140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T00:24:18.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:18.235+0000 7efc80b5e140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T00:24:18.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: Active manager daemon a restarted 2026-02-17T00:24:18.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: Activating manager daemon a 2026-02-17T00:24:18.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: osdmap e2: 0 total, 0 up, 0 in 2026-02-17T00:24:18.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: mgrmap e6: a(active, starting, since 0.00269457s) 2026-02-17T00:24:18.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T00:24:18.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T00:24:18.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: Manager daemon a is now available 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T00:24:18.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:18 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T00:24:19.266 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:24:19.267 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-17T00:24:19.267 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T00:24:19.267 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:24:19.267 INFO:teuthology.orchestra.run.trial198.stdout:mgr epoch 5 is available 2026-02-17T00:24:19.267 INFO:teuthology.orchestra.run.trial198.stdout:Setting orchestrator backend to cephadm... 2026-02-17T00:24:19.509 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-mon[39397]: Found migration_current of "None". Setting to last migration. 2026-02-17T00:24:19.510 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:19.510 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:19.510 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-mon[39397]: mgrmap e7: a(active, since 1.00342s) 2026-02-17T00:24:19.690 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-17T00:24:19.690 INFO:teuthology.orchestra.run.trial198.stdout:Generating ssh key... 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: Generating public/private ed25519 key pair. 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: Your identification has been saved in /tmp/tmp8nnq6kkf/key 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: Your public key has been saved in /tmp/tmp8nnq6kkf/key.pub 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: The key fingerprint is: 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: SHA256:EQGIxxrYZwgaAGb2lGQGdLe3Yt3sfhP2+EK4pFXM2io ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: The key's randomart image is: 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: +--[ED25519 256]--+ 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: |OXoX.o..o. | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: |*.@.B . . | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: |. B . .. o | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: | . o +. + | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: | o oSo= | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: | . . .= = | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: | +.= + | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: | E.o = . | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: | ... +. | 2026-02-17T00:24:20.092 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:19 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: +----[SHA256]-----+ 2026-02-17T00:24:20.111 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDuTWZyfWMi1u7O6DJKDFx/B4GYTVJ+IRRk7uTa2mS3m ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:20.112 INFO:teuthology.orchestra.run.trial198.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-17T00:24:20.112 INFO:teuthology.orchestra.run.trial198.stdout:Adding key to root@localhost authorized_keys... 2026-02-17T00:24:20.113 INFO:teuthology.orchestra.run.trial198.stdout:Adding host trial198... 2026-02-17T00:24:20.603 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T00:24:20.603 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T00:24:20.603 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:20.603 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:20.604 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:20.604 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:20.604 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:20.604 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:20 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:19] ENGINE Bus STARTING 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:19] ENGINE Serving on http://10.20.193.198:8765 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: Generating ssh key... 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:19] ENGINE Serving on https://10.20.193.198:7150 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:19] ENGINE Bus STARTED 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:19] ENGINE Client ('10.20.193.198', 41024) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial198", "addr": "10.20.193.198", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:21.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:21 trial198 ceph-mon[39397]: mgrmap e8: a(active, since 2s) 2026-02-17T00:24:21.754 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout Added host 'trial198' with addr '10.20.193.198' 2026-02-17T00:24:21.754 INFO:teuthology.orchestra.run.trial198.stdout:Deploying unmanaged mon service... 2026-02-17T00:24:21.986 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-17T00:24:21.986 INFO:teuthology.orchestra.run.trial198.stdout:Deploying unmanaged mgr service... 2026-02-17T00:24:22.202 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-17T00:24:22.485 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: Deploying cephadm binary to trial198 2026-02-17T00:24:22.485 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:22.485 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:22.485 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:22.485 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:22.485 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:22.486 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2987391856' entity='client.admin' 2026-02-17T00:24:22.486 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:22 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:22.643 INFO:teuthology.orchestra.run.trial198.stdout:Enabling the dashboard module... 2026-02-17T00:24:23.915 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: ignoring --setuser ceph since I am not root 2026-02-17T00:24:23.916 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: ignoring --setgroup ceph since I am not root 2026-02-17T00:24:23.916 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: Added host trial198 2026-02-17T00:24:23.916 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:23.916 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: Saving service mon spec with placement count:5 2026-02-17T00:24:23.916 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:23.916 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: Saving service mgr spec with placement count:2 2026-02-17T00:24:23.916 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1739964767' entity='client.admin' 2026-02-17T00:24:23.917 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:23.917 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:23.917 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial198", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:24:23.917 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' 2026-02-17T00:24:23.917 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.trial198", "caps": []}]: dispatch 2026-02-17T00:24:23.917 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='mgr.14118 10.20.193.198:0/2006714485' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.trial198", "caps": []}]': finished 2026-02-17T00:24:23.917 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:23 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4149969044' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for the mgr to restart... 2026-02-17T00:24:24.040 INFO:teuthology.orchestra.run.trial198.stdout:Waiting for mgr epoch 9... 2026-02-17T00:24:24.456 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.182+0000 7f26fd426140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T00:24:24.457 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.325+0000 7f26fd426140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T00:24:24.457 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.359+0000 7f26fd426140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T00:24:24.457 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.400+0000 7f26fd426140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T00:24:24.457 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.430+0000 7f26fd426140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-mon[39397]: Deploying daemon agent.trial198 on trial198 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4149969044' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-mon[39397]: mgrmap e9: a(active, since 5s) 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3107999638' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.464+0000 7f26fd426140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.528+0000 7f26fd426140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: from numpy import show_config as show_numpy_config 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.601+0000 7f26fd426140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T00:24:24.732 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.634+0000 7f26fd426140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T00:24:24.733 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.728+0000 7f26fd426140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T00:24:25.151 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.785+0000 7f26fd426140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T00:24:25.151 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.819+0000 7f26fd426140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T00:24:25.151 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.851+0000 7f26fd426140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T00:24:25.152 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.884+0000 7f26fd426140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T00:24:25.152 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:24 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:24.914+0000 7f26fd426140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T00:24:25.152 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.147+0000 7f26fd426140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T00:24:25.401 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.245+0000 7f26fd426140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T00:24:25.402 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.275+0000 7f26fd426140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T00:24:25.402 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.305+0000 7f26fd426140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T00:24:25.402 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.397+0000 7f26fd426140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T00:24:25.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.425+0000 7f26fd426140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T00:24:25.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.516+0000 7f26fd426140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T00:24:26.408 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:25 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:25.985+0000 7f26fd426140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T00:24:26.409 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:26.015+0000 7f26fd426140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T00:24:26.409 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:24:26.404+0000 7f26fd426140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T00:24:26.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: Active manager daemon a restarted 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: Activating manager daemon a 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: osdmap e3: 0 total, 0 up, 0 in 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: mgrmap e10: a(active, starting, since 0.00260236s) 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: Manager daemon a is now available 2026-02-17T00:24:26.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:26.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:26.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T00:24:26.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:26 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T00:24:27.450 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:24:27.450 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-17T00:24:27.450 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T00:24:27.450 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:24:27.450 INFO:teuthology.orchestra.run.trial198.stdout:mgr epoch 9 is available 2026-02-17T00:24:27.451 INFO:teuthology.orchestra.run.trial198.stdout:Generating a dashboard self-signed certificate... 2026-02-17T00:24:27.825 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-17T00:24:27.825 INFO:teuthology.orchestra.run.trial198.stdout:Creating initial admin user... 2026-02-17T00:24:28.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial198", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.trial198", "caps": []}]: dispatch 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: Deploying daemon agent.trial198 on trial198 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:27] ENGINE Bus STARTING 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:27] ENGINE Serving on https://10.20.193.198:7150 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:27] ENGINE Client ('10.20.193.198', 50776) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T00:24:28.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T00:24:28.208 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: mgrmap e11: a(active, since 1.0042s) 2026-02-17T00:24:28.208 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T00:24:28.208 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:27] ENGINE Serving on http://10.20.193.198:8765 2026-02-17T00:24:28.208 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: [17/Feb/2026:00:24:27] ENGINE Bus STARTED 2026-02-17T00:24:28.208 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:28.208 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:28.208 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:27 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:28.243 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$vUssVLz8q86q9Pfkl7i/j.9oVpsf6NeBH2Et11moJPi4TuSUEUX6G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771287868, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-17T00:24:28.243 INFO:teuthology.orchestra.run.trial198.stdout:Fetching dashboard port number... 2026-02-17T00:24:28.452 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stdout 8443 2026-02-17T00:24:28.460 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:24:28.460 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout disabled 2026-02-17T00:24:28.466 INFO:teuthology.orchestra.run.trial198.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:24:28.466 INFO:teuthology.orchestra.run.trial198.stdout:systemctl: stdout inactive 2026-02-17T00:24:28.466 INFO:teuthology.orchestra.run.trial198.stdout:firewalld.service is not enabled 2026-02-17T00:24:28.466 INFO:teuthology.orchestra.run.trial198.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-17T00:24:28.467 INFO:teuthology.orchestra.run.trial198.stdout:Ceph Dashboard is now available at: 2026-02-17T00:24:28.468 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.468 INFO:teuthology.orchestra.run.trial198.stdout: URL: https://trial198:8443/ 2026-02-17T00:24:28.468 INFO:teuthology.orchestra.run.trial198.stdout: User: admin 2026-02-17T00:24:28.468 INFO:teuthology.orchestra.run.trial198.stdout: Password: ucxt486upl 2026-02-17T00:24:28.468 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.468 INFO:teuthology.orchestra.run.trial198.stdout:Saving cluster configuration to /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/config directory 2026-02-17T00:24:28.713 INFO:teuthology.orchestra.run.trial198.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-17T00:24:28.713 INFO:teuthology.orchestra.run.trial198.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-17T00:24:28.713 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.713 INFO:teuthology.orchestra.run.trial198.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:24:28.713 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.713 INFO:teuthology.orchestra.run.trial198.stdout:Or, if you are only running a single cluster on this host: 2026-02-17T00:24:28.713 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: ceph telemetry on 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout:For more information see: 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-17T00:24:28.714 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:28.715 INFO:teuthology.orchestra.run.trial198.stdout:Bootstrap complete. 2026-02-17T00:24:28.740 INFO:tasks.cephadm:Fetching config... 2026-02-17T00:24:28.740 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:28.740 DEBUG:teuthology.orchestra.run.trial198:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-17T00:24:28.757 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-17T00:24:28.757 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:28.757 DEBUG:teuthology.orchestra.run.trial198:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-17T00:24:28.813 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-17T00:24:28.813 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:28.814 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-17T00:24:28.888 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-17T00:24:28.888 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:28.888 DEBUG:teuthology.orchestra.run.trial198:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-17T00:24:28.950 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-17T00:24:28.951 DEBUG:teuthology.orchestra.run.trial198:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDuTWZyfWMi1u7O6DJKDFx/B4GYTVJ+IRRk7uTa2mS3m ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T00:24:29.033 INFO:teuthology.orchestra.run.trial198.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDuTWZyfWMi1u7O6DJKDFx/B4GYTVJ+IRRk7uTa2mS3m ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:29.044 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-17T00:24:29.279 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:29 trial198 ceph-mon[39397]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:29.279 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:29 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:29.280 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:29 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3691357495' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-17T00:24:29.280 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:29 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3737937633' entity='client.admin' 2026-02-17T00:24:29.326 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:29.567 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-17T00:24:29.568 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-17T00:24:29.725 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:30.203 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-17T00:24:30.203 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd crush tunables default 2026-02-17T00:24:30.431 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: mgrmap e12: a(active, since 2s) 2026-02-17T00:24:30.431 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.431 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/782105082' entity='client.admin' 2026-02-17T00:24:30.432 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:30.433 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:30 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:24:30.652 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:31.650 INFO:teuthology.orchestra.run.trial198.stderr:adjusted tunables profile to default 2026-02-17T00:24:31.691 INFO:tasks.cephadm:Adding mon.a on trial198 2026-02-17T00:24:31.692 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph orch apply mon '1;trial198:10.20.193.198=a' 2026-02-17T00:24:31.715 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: Updating trial198:/etc/ceph/ceph.conf 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: Updating trial198:/var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/config/ceph.conf 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: Updating trial198:/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: Updating trial198:/var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:31.716 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:31.717 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4030748384' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-17T00:24:31.717 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:31 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:31.843 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:32.044 INFO:teuthology.orchestra.run.trial198.stdout:Scheduled mon update... 2026-02-17T00:24:32.082 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-17T00:24:32.082 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:24:32.282 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:32.509 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:32.509 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":1,"fsid":"f2b6e4ff-0b96-11f1-955f-d404e6e7d460","modified":"2026-02-17T00:24:07.344652Z","created":"2026-02-17T00:24:07.344652Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:3300","nonce":0},{"type":"v1","addr":"10.20.193.198:6789","nonce":0}]},"addr":"10.20.193.198:6789/0","public_addr":"10.20.193.198:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:24:32.510 INFO:teuthology.orchestra.run.trial198.stderr:dumped monmap epoch 1 2026-02-17T00:24:32.543 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-17T00:24:32.544 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-17T00:24:32.694 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:32.884 INFO:teuthology.orchestra.run.trial198.stdout:# minimal ceph.conf for f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:32.884 INFO:teuthology.orchestra.run.trial198.stdout:[global] 2026-02-17T00:24:32.885 INFO:teuthology.orchestra.run.trial198.stdout: fsid = f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:24:32.885 INFO:teuthology.orchestra.run.trial198.stdout: mon_host = [v2:10.20.193.198:3300/0,v1:10.20.193.198:6789/0] 2026-02-17T00:24:32.885 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4030748384' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-17T00:24:32.885 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: osdmap e4: 0 total, 0 up, 0 in 2026-02-17T00:24:32.885 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:32.885 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:32.885 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:32.886 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:32 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1868136450' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:24:32.918 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-17T00:24:32.918 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:32.918 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T00:24:32.944 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:32.944 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:24:33.008 INFO:tasks.cephadm:Adding mgr.a on trial198 2026-02-17T00:24:33.008 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph orch apply mgr '1;trial198=a' 2026-02-17T00:24:33.196 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:33.399 INFO:teuthology.orchestra.run.trial198.stdout:Scheduled mgr update... 2026-02-17T00:24:33.438 INFO:tasks.cephadm:Deploying OSDs... 2026-02-17T00:24:33.439 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:24:33.439 DEBUG:teuthology.orchestra.run.trial198:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:24:33.456 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T00:24:33.457 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_1 2026-02-17T00:24:33.514 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 00:24:30.022479813 +0000 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.515 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.516 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T00:24:33.578 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T00:24:33.578 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T00:24:33.578 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000171709 s, 3.0 MB/s 2026-02-17T00:24:33.580 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T00:24:33.639 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_2 2026-02-17T00:24:33.696 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T00:24:33.696 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:24:33.696 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-17T00:24:33.696 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:24:33.696 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:24:33.697 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 00:24:30.022479813 +0000 2026-02-17T00:24:33.697 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.697 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.697 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.697 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T00:24:33.760 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T00:24:33.760 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T00:24:33.761 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000160959 s, 3.2 MB/s 2026-02-17T00:24:33.762 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T00:24:33.819 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_3 2026-02-17T00:24:33.876 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T00:24:33.876 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:24:33.876 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-17T00:24:33.876 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:24:33.876 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:24:33.877 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 00:24:30.022479813 +0000 2026-02-17T00:24:33.877 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.877 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.877 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 00:23:00.136883897 +0000 2026-02-17T00:24:33.877 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T00:24:33.937 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial198:10.20.193.198=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: Saving service mon spec with placement trial198:10.20.193.198=a;count:1 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: Reconfiguring mon.a (unknown last config time)... 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: Reconfiguring daemon mon.a on trial198 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/14550182' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: mgrmap e13: a(active, since 6s) 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:33.938 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:33.939 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:24:33.939 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:33.939 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:33.939 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T00:24:33.939 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T00:24:33.939 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:33 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:33.941 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T00:24:33.941 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T00:24:33.941 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000165216 s, 3.1 MB/s 2026-02-17T00:24:33.941 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T00:24:33.998 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_4 2026-02-17T00:24:34.055 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T00:24:34.055 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:24:34.055 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-17T00:24:34.056 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:24:34.056 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:24:34.056 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 00:24:30.022479813 +0000 2026-02-17T00:24:34.056 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 00:23:00.135883915 +0000 2026-02-17T00:24:34.056 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 00:23:00.135883915 +0000 2026-02-17T00:24:34.056 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 00:23:00.135883915 +0000 2026-02-17T00:24:34.056 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T00:24:34.119 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T00:24:34.119 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T00:24:34.119 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000140821 s, 3.6 MB/s 2026-02-17T00:24:34.120 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T00:24:34.177 INFO:tasks.cephadm:Deploying osd.0 on trial198 with /dev/vg_nvme/lv_4... 2026-02-17T00:24:34.177 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-17T00:24:34.365 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:34.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:34 trial198 ceph-mon[39397]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial198=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:34.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:34 trial198 ceph-mon[39397]: Saving service mgr spec with placement trial198=a;count:1 2026-02-17T00:24:34.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:34 trial198 ceph-mon[39397]: Reconfiguring mgr.a (unknown last config time)... 2026-02-17T00:24:34.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:34 trial198 ceph-mon[39397]: Reconfiguring daemon mgr.a on trial198 2026-02-17T00:24:34.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:34 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:34.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:34 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:35.086 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:35.100 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph orch daemon add osd trial198:vg_nvme/lv_4 2026-02-17T00:24:35.247 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:35.953 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:35 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:24:35.953 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:35 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:24:35.954 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:35 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:36.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:36 trial198 ceph-mon[39397]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial198:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:36.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:36 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2069520751' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f38ea43-f01c-47d8-9057-e0ebee2667ae"}]: dispatch 2026-02-17T00:24:36.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:36 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2069520751' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f38ea43-f01c-47d8-9057-e0ebee2667ae"}]': finished 2026-02-17T00:24:36.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:36 trial198 ceph-mon[39397]: osdmap e5: 1 total, 0 up, 1 in 2026-02-17T00:24:36.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:36 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:24:36.957 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:36 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/296467725' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:24:40.180 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:40 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T00:24:40.180 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:40 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:41.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:41 trial198 ceph-mon[39397]: Deploying daemon osd.0 on trial198 2026-02-17T00:24:42.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:42.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:42.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:42.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:24:42.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:42.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:43.282 INFO:teuthology.orchestra.run.trial198.stdout:Created osd(s) 0 on host 'trial198' 2026-02-17T00:24:43.321 DEBUG:teuthology.orchestra.run.trial198:osd.0> sudo journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.0.service 2026-02-17T00:24:43.324 INFO:tasks.cephadm:Deploying osd.1 on trial198 with /dev/vg_nvme/lv_3... 2026-02-17T00:24:43.324 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-17T00:24:43.514 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:43.536 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:43.536 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:43.536 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:24:43.536 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:43.537 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:43.537 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:43.537 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:24:43.537 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:43 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:44.197 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:24:43 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0[48541]: 2026-02-17T00:24:43.960+0000 7f83492b8740 -1 Falling back to public interface 2026-02-17T00:24:44.246 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:44.263 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph orch daemon add osd trial198:vg_nvme/lv_3 2026-02-17T00:24:44.416 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:44.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:44 trial198 ceph-mon[39397]: Adjusting osd_memory_target on trial198 to 83023M 2026-02-17T00:24:45.404 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial198:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4169355296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5747882-c957-403d-a372-0e1736a94b36"}]: dispatch 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4169355296' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5747882-c957-403d-a372-0e1736a94b36"}]': finished 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: osdmap e6: 2 total, 0 up, 2 in 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:24:45.405 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:45 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:46.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:46 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2728789725' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:24:47.418 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:24:46 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0[48541]: 2026-02-17T00:24:46.992+0000 7f83492b8740 -1 osd.0 0 log_to_monitors true 2026-02-17T00:24:47.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:47 trial198 ceph-mon[39397]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:24:47.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:47 trial198 ceph-mon[39397]: from='osd.0 [v2:10.20.193.198:6802/355313918,v1:10.20.193.198:6803/355313918]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T00:24:48.627 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:24:48 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0[48541]: 2026-02-17T00:24:48.580+0000 7f8345a4c640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T00:24:48.627 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:24:48 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0[48541]: 2026-02-17T00:24:48.582+0000 7f833d05b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:24:48.627 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: from='osd.0 [v2:10.20.193.198:6802/355313918,v1:10.20.193.198:6803/355313918]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: from='osd.0 [v2:10.20.193.198:6802/355313918,v1:10.20.193.198:6803/355313918]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial198", "root=default"]}]: dispatch 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: from='osd.0 [v2:10.20.193.198:6802/355313918,v1:10.20.193.198:6803/355313918]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial198", "root=default"]}]': finished 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: osdmap e8: 2 total, 0 up, 2 in 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:24:48.628 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:48 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:49.674 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:49 trial198 ceph-mon[39397]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:24:49.675 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:49 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:24:49.675 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:49 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T00:24:49.675 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:49 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:49.675 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:49 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:24:50.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: purged_snaps scrub starts 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: purged_snaps scrub ok 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: OSD bench result of 106750.548876 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: Deploying daemon osd.1 on trial198 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: osd.0 [v2:10.20.193.198:6802/355313918,v1:10.20.193.198:6803/355313918] boot 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: osdmap e9: 2 total, 1 up, 2 in 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:50.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:50.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:50.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:50.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:24:50.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:50.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T00:24:50.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:50 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:51.633 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:24:51.633 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:24:51.633 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:24:51.634 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: Reconfiguring osd.1 (unknown last config time)... 2026-02-17T00:24:51.634 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: Reconfiguring daemon osd.1 on trial198 2026-02-17T00:24:51.634 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: osdmap e10: 2 total, 1 up, 2 in 2026-02-17T00:24:51.634 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:51.634 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:51.634 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:51.634 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:51 trial198 ceph-mon[39397]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2026-02-17T00:24:52.366 INFO:teuthology.orchestra.run.trial198.stdout:Created osd(s) 1 on host 'trial198' 2026-02-17T00:24:52.404 DEBUG:teuthology.orchestra.run.trial198:osd.1> sudo journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.1.service 2026-02-17T00:24:52.407 INFO:tasks.cephadm:Deploying osd.2 on trial198 with /dev/vg_nvme/lv_2... 2026-02-17T00:24:52.407 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-17T00:24:52.597 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:53.206 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:24:52 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1[52408]: 2026-02-17T00:24:52.949+0000 7f0cd9237740 -1 Falling back to public interface 2026-02-17T00:24:53.330 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:24:53.345 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph orch daemon add osd trial198:vg_nvme/lv_2 2026-02-17T00:24:53.495 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:24:53.517 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T00:24:53.517 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: Adjusting osd_memory_target on trial198 to 41511M 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:53.518 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:53.519 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:24:53.519 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T00:24:53.519 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:53 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:24:54.478 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:54 trial198 ceph-mon[39397]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2026-02-17T00:24:54.478 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:54 trial198 ceph-mon[39397]: Cluster is now healthy 2026-02-17T00:24:54.478 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:54 trial198 ceph-mon[39397]: from='client.14201 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial198:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:24:54.478 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:54 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:24:54.478 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:54 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:24:54.479 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:54 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:55.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:55 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2107137149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e072c0ac-bcac-4d37-a3b1-339cdd24d85f"}]: dispatch 2026-02-17T00:24:55.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:55 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2107137149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e072c0ac-bcac-4d37-a3b1-339cdd24d85f"}]': finished 2026-02-17T00:24:55.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:55 trial198 ceph-mon[39397]: osdmap e11: 3 total, 1 up, 3 in 2026-02-17T00:24:55.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:55 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:55.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:55 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:24:55.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:55 trial198 ceph-mon[39397]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T00:24:55.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:55 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/828767895' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:24:56.386 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:24:55 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1[52408]: 2026-02-17T00:24:55.970+0000 7f0cd9237740 -1 osd.1 0 log_to_monitors true 2026-02-17T00:24:56.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:56 trial198 ceph-mon[39397]: from='osd.1 [v2:10.20.193.198:6810/629789774,v1:10.20.193.198:6811/629789774]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T00:24:57.642 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:24:57 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1[52408]: 2026-02-17T00:24:57.556+0000 7f0cd51b8640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T00:24:57.642 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:24:57 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1[52408]: 2026-02-17T00:24:57.557+0000 7f0cccfda640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:24:57.642 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:57 trial198 ceph-mon[39397]: from='osd.1 [v2:10.20.193.198:6810/629789774,v1:10.20.193.198:6811/629789774]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T00:24:57.642 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:57 trial198 ceph-mon[39397]: osdmap e12: 3 total, 1 up, 3 in 2026-02-17T00:24:57.642 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:57 trial198 ceph-mon[39397]: from='osd.1 [v2:10.20.193.198:6810/629789774,v1:10.20.193.198:6811/629789774]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial198", "root=default"]}]: dispatch 2026-02-17T00:24:57.642 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:57 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:57.643 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:57 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:24:57.643 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:57 trial198 ceph-mon[39397]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T00:24:58.449 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:58 trial198 ceph-mon[39397]: from='osd.1 [v2:10.20.193.198:6810/629789774,v1:10.20.193.198:6811/629789774]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial198", "root=default"]}]': finished 2026-02-17T00:24:58.449 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:58 trial198 ceph-mon[39397]: osdmap e13: 3 total, 1 up, 3 in 2026-02-17T00:24:58.449 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:58 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:58.449 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:58 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:24:58.450 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:58 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:59.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: purged_snaps scrub starts 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: purged_snaps scrub ok 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: OSD bench result of 105052.889928 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: osd.1 [v2:10.20.193.198:6810/629789774,v1:10.20.193.198:6811/629789774] boot 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: osdmap e14: 3 total, 2 up, 3 in 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: Deploying daemon osd.2 on trial198 2026-02-17T00:24:59.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:24:59 trial198 ceph-mon[39397]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T00:25:00.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:00 trial198 ceph-mon[39397]: osdmap e15: 3 total, 2 up, 3 in 2026-02-17T00:25:00.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:00 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:25:01.416 INFO:teuthology.orchestra.run.trial198.stdout:Created osd(s) 2 on host 'trial198' 2026-02-17T00:25:01.454 DEBUG:teuthology.orchestra.run.trial198:osd.2> sudo journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.2.service 2026-02-17T00:25:01.455 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2026-02-17T00:25:01.455 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:25:01.654 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:01.678 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:01 trial198 ceph-mon[39397]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T00:25:01.678 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:01 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:01.678 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:01 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:01.678 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:01 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:01.678 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:01 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:01.678 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:01 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:01.679 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:01 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:01.844 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:01.880 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771287898,"num_in_osds":3,"osd_in_since":1771287894,"num_remapped_pgs":0} 2026-02-17T00:25:02.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: Adjusting osd_memory_target on trial198 to 27674M 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:02.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:02.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:02.708 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4206655633' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:25:02.708 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:02 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2[55889]: 2026-02-17T00:25:02.440+0000 7fe6e0554740 -1 Falling back to public interface 2026-02-17T00:25:02.881 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:25:03.031 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:03.224 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:03.260 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771287898,"num_in_osds":3,"osd_in_since":1771287894,"num_remapped_pgs":0} 2026-02-17T00:25:03.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:03 trial198 ceph-mon[39397]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T00:25:03.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3466541129' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:25:04.261 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:25:04.413 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:04.612 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:04.650 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771287898,"num_in_osds":3,"osd_in_since":1771287894,"num_remapped_pgs":0} 2026-02-17T00:25:05.652 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:25:05.806 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:05.828 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:05 trial198 ceph-mon[39397]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T00:25:05.828 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:05 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3010922803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:25:05.828 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:05 trial198 ceph-mon[39397]: from='osd.2 [v2:10.20.193.198:6818/3524486527,v1:10.20.193.198:6819/3524486527]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T00:25:05.828 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:05 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2[55889]: 2026-02-17T00:25:05.471+0000 7fe6e0554740 -1 osd.2 0 log_to_monitors true 2026-02-17T00:25:05.998 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:06.051 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":16,"num_osds":3,"num_up_osds":2,"osd_up_since":1771287898,"num_in_osds":3,"osd_in_since":1771287894,"num_remapped_pgs":0} 2026-02-17T00:25:06.958 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:06 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2[55889]: 2026-02-17T00:25:06.768+0000 7fe6dc4d5640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T00:25:06.959 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:06 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2[55889]: 2026-02-17T00:25:06.769+0000 7fe6d42f7640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:25:06.960 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:06 trial198 ceph-mon[39397]: from='osd.2 [v2:10.20.193.198:6818/3524486527,v1:10.20.193.198:6819/3524486527]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T00:25:06.960 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:06 trial198 ceph-mon[39397]: osdmap e16: 3 total, 2 up, 3 in 2026-02-17T00:25:06.960 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:06 trial198 ceph-mon[39397]: from='osd.2 [v2:10.20.193.198:6818/3524486527,v1:10.20.193.198:6819/3524486527]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial198", "root=default"]}]: dispatch 2026-02-17T00:25:06.960 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:06 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:25:06.960 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:06 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1732976498' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:25:06.960 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:06 trial198 ceph-mon[39397]: from='osd.2 [v2:10.20.193.198:6818/3524486527,v1:10.20.193.198:6819/3524486527]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial198", "root=default"]}]': finished 2026-02-17T00:25:07.053 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:25:07.202 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:07.395 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:07.430 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":17,"num_osds":3,"num_up_osds":2,"osd_up_since":1771287898,"num_in_osds":3,"osd_in_since":1771287894,"num_remapped_pgs":0} 2026-02-17T00:25:07.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:07 trial198 ceph-mon[39397]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T00:25:07.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:07 trial198 ceph-mon[39397]: osdmap e17: 3 total, 2 up, 3 in 2026-02-17T00:25:07.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:07 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:25:07.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:07 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4284950209' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:25:08.431 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:25:08.586 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:08.781 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: purged_snaps scrub starts 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: purged_snaps scrub ok 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: OSD bench result of 115701.401372 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.2. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: osd.2 [v2:10.20.193.198:6818/3524486527,v1:10.20.193.198:6819/3524486527] boot 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: osdmap e18: 3 total, 3 up, 3 in 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:25:08.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:08 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:25:08.817 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1771287907,"num_in_osds":3,"osd_in_since":1771287894,"num_remapped_pgs":0} 2026-02-17T00:25:08.819 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T00:25:08.968 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:09.158 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:09.158 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":19,"fsid":"f2b6e4ff-0b96-11f1-955f-d404e6e7d460","created":"2026-02-17T00:24:08.305123+0000","modified":"2026-02-17T00:25:08.605957+0000","last_up_change":"2026-02-17T00:25:07.605375+0000","last_in_change":"2026-02-17T00:24:54.381650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T00:25:08.440887+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f38ea43-f01c-47d8-9057-e0ebee2667ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6802","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6803","nonce":355313918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6804","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6805","nonce":355313918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6808","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6809","nonce":355313918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6806","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6807","nonce":355313918}]},"public_addr":"10.20.193.198:6803/355313918","cluster_addr":"10.20.193.198:6805/355313918","heartbeat_back_addr":"10.20.193.198:6809/355313918","heartbeat_front_addr":"10.20.193.198:6807/355313918","state":["exists","up"]},{"osd":1,"uuid":"c5747882-c957-403d-a372-0e1736a94b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6810","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6811","nonce":629789774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6812","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6813","nonce":629789774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6816","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6817","nonce":629789774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6814","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6815","nonce":629789774}]},"public_addr":"10.20.193.198:6811/629789774","cluster_addr":"10.20.193.198:6813/629789774","heartbeat_back_addr":"10.20.193.198:6817/629789774","heartbeat_front_addr":"10.20.193.198:6815/629789774","state":["exists","up"]},{"osd":2,"uuid":"e072c0ac-bcac-4d37-a3b1-339cdd24d85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6818","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6819","nonce":3524486527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6820","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6821","nonce":3524486527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6824","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6825","nonce":3524486527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6822","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6823","nonce":3524486527}]},"public_addr":"10.20.193.198:6819/3524486527","cluster_addr":"10.20.193.198:6821/3524486527","heartbeat_back_addr":"10.20.193.198:6825/3524486527","heartbeat_front_addr":"10.20.193.198:6823/3524486527","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:24:48.008684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:24:56.926826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:25:06.460636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.198:6800/1851921093":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/3614989935":"2026-02-18T00:24:26.406176+0000","10.20.193.198:6801/1851921093":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/3376513897":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/64104427":"2026-02-18T00:24:18.237472+0000","10.20.193.198:6801/423908301":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/3312434815":"2026-02-18T00:24:26.406176+0000","10.20.193.198:6800/423908301":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/3104668697":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/591619093":"2026-02-18T00:24:18.237472+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:25:09.194 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-17T00:25:08.440887+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T00:25:09.196 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-17T00:25:09.345 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:09.532 INFO:teuthology.orchestra.run.trial198.stdout:pg_num: 1 2026-02-17T00:25:09.568 INFO:tasks.cephadm:Setting up client nodes... 2026-02-17T00:25:09.568 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T00:25:09.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:09 trial198 ceph-mon[39397]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T00:25:09.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:09 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T00:25:09.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:09 trial198 ceph-mon[39397]: osdmap e19: 3 total, 3 up, 3 in 2026-02-17T00:25:09.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:09 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:25:09.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:09 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1036606387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:25:09.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:09 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3733972102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:25:09.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:09 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2801183504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-17T00:25:09.716 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:09.945 INFO:teuthology.orchestra.run.trial198.stdout:[client.0] 2026-02-17T00:25:09.945 INFO:teuthology.orchestra.run.trial198.stdout: key = AQBltZNp7TYXOBAA0jgwuiSn1e3Lj57vs+XT0A== 2026-02-17T00:25:09.982 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:25:09.982 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-17T00:25:09.982 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T00:25:10.017 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T00:25:10.017 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-17T00:25:10.017 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-17T00:25:10.204 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:10.423 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:10.470 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6800","nonce":892320664},{"type":"v1","addr":"10.20.193.198:6801","nonce":892320664}]},"active_addr":"10.20.193.198:6801/892320664","active_change":"2026-02-17T00:24:26.406260+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.198:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.198:0","nonce":204575588}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.198:0","nonce":4246252769}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.198:0","nonce":1357475431}]}]} 2026-02-17T00:25:10.475 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-17T00:25:10.475 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-17T00:25:10.475 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T00:25:10.509 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58394]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T00:25:10.510 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58394]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.510 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.510 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58394]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.510 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58443]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T00:25:10.510 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58443]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.510 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.510 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58443]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.637 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:10.778 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58559]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T00:25:10.778 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.778 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.779 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58559]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.779 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58590]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T00:25:10.779 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58590]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.779 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.779 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58590]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.779 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: osdmap e20: 3 total, 3 up, 3 in 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/260475154' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/260475154' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4133931334' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:10.780 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:10.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:10.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:10.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:10.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:10.781 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:10 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:10.782 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58493]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T00:25:10.782 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58493]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.782 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.782 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58493]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.782 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58505]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T00:25:10.782 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58505]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.782 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.783 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58505]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.783 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58509]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T00:25:10.783 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58509]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.783 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.783 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58509]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.784 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58525]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T00:25:10.784 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58525]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:25:10.784 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:25:10.784 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:25:10 trial198 sudo[58525]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:25:10.851 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:10.851 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":20,"fsid":"f2b6e4ff-0b96-11f1-955f-d404e6e7d460","created":"2026-02-17T00:24:08.305123+0000","modified":"2026-02-17T00:25:09.607479+0000","last_up_change":"2026-02-17T00:25:07.605375+0000","last_in_change":"2026-02-17T00:24:54.381650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T00:25:08.440887+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f38ea43-f01c-47d8-9057-e0ebee2667ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6802","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6803","nonce":355313918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6804","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6805","nonce":355313918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6808","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6809","nonce":355313918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6806","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6807","nonce":355313918}]},"public_addr":"10.20.193.198:6803/355313918","cluster_addr":"10.20.193.198:6805/355313918","heartbeat_back_addr":"10.20.193.198:6809/355313918","heartbeat_front_addr":"10.20.193.198:6807/355313918","state":["exists","up"]},{"osd":1,"uuid":"c5747882-c957-403d-a372-0e1736a94b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6810","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6811","nonce":629789774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6812","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6813","nonce":629789774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6816","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6817","nonce":629789774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6814","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6815","nonce":629789774}]},"public_addr":"10.20.193.198:6811/629789774","cluster_addr":"10.20.193.198:6813/629789774","heartbeat_back_addr":"10.20.193.198:6817/629789774","heartbeat_front_addr":"10.20.193.198:6815/629789774","state":["exists","up"]},{"osd":2,"uuid":"e072c0ac-bcac-4d37-a3b1-339cdd24d85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6818","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6819","nonce":3524486527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6820","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6821","nonce":3524486527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6824","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6825","nonce":3524486527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6822","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6823","nonce":3524486527}]},"public_addr":"10.20.193.198:6819/3524486527","cluster_addr":"10.20.193.198:6821/3524486527","heartbeat_back_addr":"10.20.193.198:6825/3524486527","heartbeat_front_addr":"10.20.193.198:6823/3524486527","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:24:48.008684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:24:56.926826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:25:06.460636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.198:6800/1851921093":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/3614989935":"2026-02-18T00:24:26.406176+0000","10.20.193.198:6801/1851921093":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/3376513897":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/64104427":"2026-02-18T00:24:18.237472+0000","10.20.193.198:6801/423908301":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/3312434815":"2026-02-18T00:24:26.406176+0000","10.20.193.198:6800/423908301":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/3104668697":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/591619093":"2026-02-18T00:24:18.237472+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:25:10.892 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-17T00:25:10.892 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T00:25:11.087 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:11.294 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:11.295 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":21,"fsid":"f2b6e4ff-0b96-11f1-955f-d404e6e7d460","created":"2026-02-17T00:24:08.305123+0000","modified":"2026-02-17T00:25:10.941592+0000","last_up_change":"2026-02-17T00:25:07.605375+0000","last_in_change":"2026-02-17T00:24:54.381650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T00:25:08.440887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f38ea43-f01c-47d8-9057-e0ebee2667ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6802","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6803","nonce":355313918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6804","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6805","nonce":355313918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6808","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6809","nonce":355313918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6806","nonce":355313918},{"type":"v1","addr":"10.20.193.198:6807","nonce":355313918}]},"public_addr":"10.20.193.198:6803/355313918","cluster_addr":"10.20.193.198:6805/355313918","heartbeat_back_addr":"10.20.193.198:6809/355313918","heartbeat_front_addr":"10.20.193.198:6807/355313918","state":["exists","up"]},{"osd":1,"uuid":"c5747882-c957-403d-a372-0e1736a94b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6810","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6811","nonce":629789774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6812","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6813","nonce":629789774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6816","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6817","nonce":629789774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6814","nonce":629789774},{"type":"v1","addr":"10.20.193.198:6815","nonce":629789774}]},"public_addr":"10.20.193.198:6811/629789774","cluster_addr":"10.20.193.198:6813/629789774","heartbeat_back_addr":"10.20.193.198:6817/629789774","heartbeat_front_addr":"10.20.193.198:6815/629789774","state":["exists","up"]},{"osd":2,"uuid":"e072c0ac-bcac-4d37-a3b1-339cdd24d85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6818","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6819","nonce":3524486527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6820","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6821","nonce":3524486527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6824","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6825","nonce":3524486527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.198:6822","nonce":3524486527},{"type":"v1","addr":"10.20.193.198:6823","nonce":3524486527}]},"public_addr":"10.20.193.198:6819/3524486527","cluster_addr":"10.20.193.198:6821/3524486527","heartbeat_back_addr":"10.20.193.198:6825/3524486527","heartbeat_front_addr":"10.20.193.198:6823/3524486527","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:24:48.008684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:24:56.926826+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:25:06.460636+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.198:6800/1851921093":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/3614989935":"2026-02-18T00:24:26.406176+0000","10.20.193.198:6801/1851921093":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/3376513897":"2026-02-18T00:24:26.406176+0000","10.20.193.198:0/64104427":"2026-02-18T00:24:18.237472+0000","10.20.193.198:6801/423908301":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/3312434815":"2026-02-18T00:24:26.406176+0000","10.20.193.198:6800/423908301":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/3104668697":"2026-02-18T00:24:18.237472+0000","10.20.193.198:0/591619093":"2026-02-18T00:24:18.237472+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:25:11.332 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-17T00:25:11.333 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-17T00:25:11.334 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-17T00:25:11.492 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:11.496 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:11.497 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:11.655 INFO:teuthology.orchestra.run.trial198.stdout:38654705672 2026-02-17T00:25:11.656 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T00:25:11.658 INFO:teuthology.orchestra.run.trial198.stdout:60129542149 2026-02-17T00:25:11.658 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T00:25:11.662 INFO:teuthology.orchestra.run.trial198.stdout:77309411332 2026-02-17T00:25:11.662 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T00:25:11.809 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:11.877 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: pgmap v35: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:11.877 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: Detected new or changed devices on trial198 2026-02-17T00:25:11.877 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: pgmap v36: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: pgmap v37: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3847823864' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:11.878 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:11.879 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:11.879 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:11.879 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:11.879 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: osdmap e21: 3 total, 3 up, 3 in 2026-02-17T00:25:11.879 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:11 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/523764375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:25:11.897 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:11.898 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:12.027 INFO:teuthology.orchestra.run.trial198.stdout:38654705671 2026-02-17T00:25:12.065 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.0 2026-02-17T00:25:12.105 INFO:teuthology.orchestra.run.trial198.stdout:60129542148 2026-02-17T00:25:12.106 INFO:teuthology.orchestra.run.trial198.stdout:77309411331 2026-02-17T00:25:12.142 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2026-02-17T00:25:12.152 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411331 for osd.2 2026-02-17T00:25:12.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:12 trial198 ceph-mon[39397]: pgmap v38: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:12.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:12 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1531427948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T00:25:12.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:12 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1545135748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T00:25:12.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:12 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2046758498' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T00:25:13.066 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T00:25:13.142 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T00:25:13.152 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T00:25:13.220 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:13.307 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:13.375 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:13.424 INFO:teuthology.orchestra.run.trial198.stdout:38654705671 2026-02-17T00:25:13.462 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.0 2026-02-17T00:25:13.506 INFO:teuthology.orchestra.run.trial198.stdout:60129542148 2026-02-17T00:25:13.542 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2026-02-17T00:25:13.568 INFO:teuthology.orchestra.run.trial198.stdout:77309411331 2026-02-17T00:25:13.605 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411331 for osd.2 2026-02-17T00:25:13.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:13 trial198 ceph-mon[39397]: mgrmap e14: a(active, since 46s) 2026-02-17T00:25:13.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:13 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4215242857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T00:25:13.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:13 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1591692022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T00:25:13.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:13 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2280229681' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T00:25:14.463 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T00:25:14.542 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T00:25:14.606 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T00:25:14.612 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:14.697 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:14.744 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:14 trial198 ceph-mon[39397]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:14.783 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:14.811 INFO:teuthology.orchestra.run.trial198.stdout:38654705672 2026-02-17T00:25:14.855 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2026-02-17T00:25:14.856 DEBUG:teuthology.parallel:result is None 2026-02-17T00:25:14.898 INFO:teuthology.orchestra.run.trial198.stdout:60129542149 2026-02-17T00:25:14.935 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2026-02-17T00:25:14.936 DEBUG:teuthology.parallel:result is None 2026-02-17T00:25:14.985 INFO:teuthology.orchestra.run.trial198.stdout:77309411332 2026-02-17T00:25:15.021 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411332 for osd.2 2026-02-17T00:25:15.021 DEBUG:teuthology.parallel:result is None 2026-02-17T00:25:15.021 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-17T00:25:15.022 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T00:25:15.173 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:15.367 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:15.367 INFO:teuthology.orchestra.run.trial198.stderr:dumped all 2026-02-17T00:25:15.403 INFO:teuthology.orchestra.run.trial198.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T00:25:14.861951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83784,"kb_used_data":2260,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201925816,"statfs":{"total":2254857830400,"available":2254772035584,"internally_reserved":0,"allocated":2314240,"data_stored":1925955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000305"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-17T00:25:11.375374+0000","last_change":"2026-02-17T00:25:10.426745+0000","last_active":"2026-02-17T00:25:11.375374+0000","last_peered":"2026-02-17T00:25:11.375374+0000","last_clean":"2026-02-17T00:25:11.375374+0000","last_became_active":"2026-02-17T00:25:10.426201+0000","last_became_peered":"2026-02-17T00:25:10.426201+0000","last_unstale":"2026-02-17T00:25:11.375374+0000","last_undegraded":"2026-02-17T00:25:11.375374+0000","last_fullsized":"2026-02-17T00:25:11.375374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:25:08.605957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:25:08.605957+0000","last_clean_scrub_stamp":"2026-02-17T00:25:08.605957+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:15:47.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411333,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27912,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975288,"statfs":{"total":751619276800,"available":751590694912,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27912,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975288,"statfs":{"total":751619276800,"available":751590694912,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27960,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975240,"statfs":{"total":751619276800,"available":751590645760,"internally_reserved":0,"allocated":765952,"data_stored":639595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:25:15.404 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T00:25:15.557 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:15.744 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:15.744 INFO:teuthology.orchestra.run.trial198.stderr:dumped all 2026-02-17T00:25:15.793 INFO:teuthology.orchestra.run.trial198.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T00:25:14.861951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83784,"kb_used_data":2260,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201925816,"statfs":{"total":2254857830400,"available":2254772035584,"internally_reserved":0,"allocated":2314240,"data_stored":1925955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000305"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-17T00:25:11.375374+0000","last_change":"2026-02-17T00:25:10.426745+0000","last_active":"2026-02-17T00:25:11.375374+0000","last_peered":"2026-02-17T00:25:11.375374+0000","last_clean":"2026-02-17T00:25:11.375374+0000","last_became_active":"2026-02-17T00:25:10.426201+0000","last_became_peered":"2026-02-17T00:25:10.426201+0000","last_unstale":"2026-02-17T00:25:11.375374+0000","last_undegraded":"2026-02-17T00:25:11.375374+0000","last_fullsized":"2026-02-17T00:25:11.375374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:25:08.605957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:25:08.605957+0000","last_clean_scrub_stamp":"2026-02-17T00:25:08.605957+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:15:47.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411333,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27912,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975288,"statfs":{"total":751619276800,"available":751590694912,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27912,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975288,"statfs":{"total":751619276800,"available":751590694912,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27960,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975240,"statfs":{"total":751619276800,"available":751590645760,"internally_reserved":0,"allocated":765952,"data_stored":639595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:25:15.794 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-17T00:25:15.794 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T00:25:15.794 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-17T00:25:15.795 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph health --format=json 2026-02-17T00:25:15.941 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:15.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:15 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1028884454' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T00:25:15.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:15 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4107227413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T00:25:15.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:15 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4073597169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T00:25:16.150 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T00:25:16.150 INFO:teuthology.orchestra.run.trial198.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T00:25:16.185 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-17T00:25:16.186 INFO:tasks.cephadm:Setup complete, yielding 2026-02-17T00:25:16.186 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-17T00:25:16.201 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial198.front.sepia.ceph.com 2026-02-17T00:25:16.201 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- bash -c 'ceph osd pool create foo' 2026-02-17T00:25:16.351 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:16.631 INFO:teuthology.orchestra.run.trial198.stderr:pool 'foo' created 2026-02-17T00:25:16.670 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- bash -c 'rbd pool init foo' 2026-02-17T00:25:16.819 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:16.934 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:16 trial198 ceph-mon[39397]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:16.934 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:16 trial198 ceph-mon[39397]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:25:16.934 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:16 trial198 ceph-mon[39397]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:25:16.934 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:16 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/521282440' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T00:25:16.934 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:16 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2754512185' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2026-02-17T00:25:17.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:17 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2754512185' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2026-02-17T00:25:17.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:17 trial198 ceph-mon[39397]: osdmap e22: 3 total, 3 up, 3 in 2026-02-17T00:25:17.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:17 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2621644039' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2026-02-17T00:25:18.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:18 trial198 ceph-mon[39397]: pgmap v43: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:18.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:18 trial198 ceph-mon[39397]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-17T00:25:18.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:18 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2621644039' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2026-02-17T00:25:18.956 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:18 trial198 ceph-mon[39397]: osdmap e23: 3 total, 3 up, 3 in 2026-02-17T00:25:19.676 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- bash -c 'ceph orch apply iscsi foo u p' 2026-02-17T00:25:19.824 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:19.892 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:19 trial198 ceph-mon[39397]: osdmap e24: 3 total, 3 up, 3 in 2026-02-17T00:25:20.034 INFO:teuthology.orchestra.run.trial198.stdout:Scheduled iscsi.foo update... 2026-02-17T00:25:20.087 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T00:25:20.116 INFO:tasks.workunit:Pulling workunits from ref 05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:25:20.117 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T00:25:20.117 DEBUG:teuthology.orchestra.run.trial198:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:25:20.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:25:20.134 INFO:teuthology.orchestra.run.trial198.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T00:25:20.135 DEBUG:teuthology.orchestra.run.trial198:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:25:20.192 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T00:25:20.193 DEBUG:teuthology.orchestra.run.trial198:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T00:25:20.250 INFO:tasks.workunit:timeout=3h 2026-02-17T00:25:20.250 INFO:tasks.workunit:cleanup=True 2026-02-17T00:25:20.251 DEBUG:teuthology.orchestra.run.trial198:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:25:20.313 INFO:tasks.workunit.client.0.trial198.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T00:25:20.785 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: pgmap v46: 33 pgs: 23 unknown, 10 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:20.785 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-17T00:25:20.785 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: Cluster is now healthy 2026-02-17T00:25:20.785 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: osdmap e25: 3 total, 3 up, 3 in 2026-02-17T00:25:20.785 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:20.785 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:20.785 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:20.786 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:20.786 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:20.786 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.trial198.roacgx", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2026-02-17T00:25:20.786 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.trial198.roacgx", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2026-02-17T00:25:20.786 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:20 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: Saving service iscsi.foo spec with placement count:1 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: Deploying daemon iscsi.foo.trial198.roacgx on trial198 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: Checking pool "foo" exists for service iscsi.foo 2026-02-17T00:25:21.767 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: Adding iSCSI gateway http://:@10.20.193.198:5000 to Dashboard 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2026-02-17T00:25:21.768 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "trial198"}]: dispatch 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "trial198"}]: dispatch 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3065816543' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2237782856' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6800/1851921093"}]: dispatch 2026-02-17T00:25:21.769 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:21 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:23.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: pgmap v48: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:23.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2237782856' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6800/1851921093"}]': finished 2026-02-17T00:25:23.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: osdmap e26: 3 total, 3 up, 3 in 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1938209522' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3614989935"}]: dispatch 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:25:23.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:22 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:24.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:23 trial198 ceph-mon[39397]: Detected new or changed devices on trial198 2026-02-17T00:25:24.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:23 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1938209522' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3614989935"}]': finished 2026-02-17T00:25:24.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:23 trial198 ceph-mon[39397]: osdmap e27: 3 total, 3 up, 3 in 2026-02-17T00:25:24.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:23 trial198 ceph-mon[39397]: mgrmap e15: a(active, since 56s) 2026-02-17T00:25:24.207 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:23 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/309733473' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6801/1851921093"}]: dispatch 2026-02-17T00:25:25.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:24 trial198 ceph-mon[39397]: pgmap v50: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:25:25.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:24 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/309733473' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6801/1851921093"}]': finished 2026-02-17T00:25:25.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:24 trial198 ceph-mon[39397]: osdmap e28: 3 total, 3 up, 3 in 2026-02-17T00:25:25.206 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:24 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/351028534' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3376513897"}]: dispatch 2026-02-17T00:25:26.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:25 trial198 ceph-mon[39397]: pgmap v53: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail; 587 B/s rd, 587 B/s wr, 2 op/s 2026-02-17T00:25:26.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:25 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/351028534' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3376513897"}]': finished 2026-02-17T00:25:26.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:25 trial198 ceph-mon[39397]: osdmap e29: 3 total, 3 up, 3 in 2026-02-17T00:25:26.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:25 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3454609016' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/64104427"}]: dispatch 2026-02-17T00:25:27.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:26 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3454609016' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/64104427"}]': finished 2026-02-17T00:25:27.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:26 trial198 ceph-mon[39397]: osdmap e30: 3 total, 3 up, 3 in 2026-02-17T00:25:27.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:26 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1152903379' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6801/423908301"}]: dispatch 2026-02-17T00:25:28.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:27 trial198 ceph-mon[39397]: pgmap v56: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail; 767 B/s rd, 767 B/s wr, 3 op/s 2026-02-17T00:25:28.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:27 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1152903379' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6801/423908301"}]': finished 2026-02-17T00:25:28.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:27 trial198 ceph-mon[39397]: osdmap e31: 3 total, 3 up, 3 in 2026-02-17T00:25:28.457 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:27 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2469436864' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3312434815"}]: dispatch 2026-02-17T00:25:29.333 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:28 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2469436864' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3312434815"}]': finished 2026-02-17T00:25:29.333 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:28 trial198 ceph-mon[39397]: osdmap e32: 3 total, 3 up, 3 in 2026-02-17T00:25:29.333 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:28 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/950677988' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6800/423908301"}]: dispatch 2026-02-17T00:25:30.335 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:29 trial198 ceph-mon[39397]: pgmap v59: 33 pgs: 33 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T00:25:30.335 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:29 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/950677988' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:6800/423908301"}]': finished 2026-02-17T00:25:30.335 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:29 trial198 ceph-mon[39397]: osdmap e33: 3 total, 3 up, 3 in 2026-02-17T00:25:30.335 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:29 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/270962832' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3104668697"}]: dispatch 2026-02-17T00:25:30.336 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:29 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/270962832' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/3104668697"}]': finished 2026-02-17T00:25:30.336 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:29 trial198 ceph-mon[39397]: osdmap e34: 3 total, 3 up, 3 in 2026-02-17T00:25:30.336 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:29 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4181574975' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/591619093"}]: dispatch 2026-02-17T00:25:31.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:31 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4181574975' entity='client.iscsi.foo.trial198.roacgx' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "10.20.193.198:0/591619093"}]': finished 2026-02-17T00:25:31.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:31 trial198 ceph-mon[39397]: osdmap e35: 3 total, 3 up, 3 in 2026-02-17T00:25:32.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:32 trial198 ceph-mon[39397]: pgmap v63: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.3 KiB/s rd, 1 op/s 2026-02-17T00:25:32.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:32 trial198 ceph-mon[39397]: from='client.14280 -' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T00:25:34.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:34 trial198 ceph-mon[39397]: pgmap v64: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.0 KiB/s rd, 1 op/s 2026-02-17T00:25:36.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:36 trial198 ceph-mon[39397]: pgmap v65: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:25:38.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:38 trial198 ceph-mon[39397]: pgmap v66: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 650 B/s rd, 0 op/s 2026-02-17T00:25:40.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:40 trial198 ceph-mon[39397]: pgmap v67: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.0 KiB/s rd, 1 op/s 2026-02-17T00:25:42.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: pgmap v68: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 971 B/s rd, 0 op/s 2026-02-17T00:25:42.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: from='client.14280 -' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T00:25:42.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:42.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:42.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:42.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:42.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:42.707 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:42 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:25:44.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:44 trial198 ceph-mon[39397]: pgmap v69: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:25:46.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:46 trial198 ceph-mon[39397]: pgmap v70: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr:Note: switching to '05b55d192f002ad5df41409624b8d176527d0841'. 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr: 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr: 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T00:25:46.836 INFO:tasks.workunit.client.0.trial198.stderr: 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr: git switch -c 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr: 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr:Or undo this operation with: 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr: 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr: git switch - 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr: 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr: 2026-02-17T00:25:46.837 INFO:tasks.workunit.client.0.trial198.stderr:HEAD is now at 05b55d192f0 mgr/dashboard: start node virtual-env after starting ceph cluster 2026-02-17T00:25:46.844 DEBUG:teuthology.orchestra.run.trial198:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T00:25:46.902 INFO:tasks.workunit.client.0.trial198.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-17T00:25:46.904 INFO:tasks.workunit.client.0.trial198.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T00:25:46.904 INFO:tasks.workunit.client.0.trial198.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-17T00:25:47.000 INFO:tasks.workunit.client.0.trial198.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-17T00:25:47.029 INFO:tasks.workunit.client.0.trial198.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-17T00:25:47.052 INFO:tasks.workunit.client.0.trial198.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T00:25:47.054 INFO:tasks.workunit.client.0.trial198.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T00:25:47.054 INFO:tasks.workunit.client.0.trial198.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-17T00:25:47.077 INFO:tasks.workunit.client.0.trial198.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T00:25:47.080 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T00:25:47.080 DEBUG:teuthology.orchestra.run.trial198:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T00:25:47.138 INFO:tasks.workunit:Running workunits matching cephadm/test_iscsi_pids_limit.sh on client.0... 2026-02-17T00:25:47.138 INFO:tasks.workunit:Running workunit cephadm/test_iscsi_pids_limit.sh... 2026-02-17T00:25:47.139 DEBUG:teuthology.orchestra.run.trial198:workunit test cephadm/test_iscsi_pids_limit.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=05b55d192f002ad5df41409624b8d176527d0841 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_pids_limit.sh 2026-02-17T00:25:47.198 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman ps -qa --filter=name=iscsi 2026-02-17T00:25:47.229 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_CONT_IDS='2d1981484e0f 2026-02-17T00:25:47.229 INFO:tasks.workunit.client.0.trial198.stderr:8a9c9989b4f4' 2026-02-17T00:25:47.229 INFO:tasks.workunit.client.0.trial198.stderr:++ echo 2d1981484e0f 8a9c9989b4f4 2026-02-17T00:25:47.229 INFO:tasks.workunit.client.0.trial198.stderr:++ wc -w 2026-02-17T00:25:47.230 INFO:tasks.workunit.client.0.trial198.stderr:+ CONT_COUNT=2 2026-02-17T00:25:47.230 INFO:tasks.workunit.client.0.trial198.stderr:+ test 2 -eq 2 2026-02-17T00:25:47.230 INFO:tasks.workunit.client.0.trial198.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T00:25:47.230 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 2d1981484e0f cat /sys/fs/cgroup/pids/pids.max 2026-02-17T00:25:47.264 INFO:tasks.workunit.client.0.trial198.stderr:cat: /sys/fs/cgroup/pids/pids.max: No such file or directory 2026-02-17T00:25:47.311 INFO:tasks.workunit.client.0.trial198.stderr:+ '[' ']' 2026-02-17T00:25:47.311 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 2d1981484e0f cat /sys/fs/cgroup/pids.max 2026-02-17T00:25:47.348 INFO:tasks.workunit.client.0.trial198.stderr:+ '[' max ']' 2026-02-17T00:25:47.348 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 2d1981484e0f cat /sys/fs/cgroup/pids.max 2026-02-17T00:25:47.426 INFO:tasks.workunit.client.0.trial198.stderr:+ pid_limit=max 2026-02-17T00:25:47.426 INFO:tasks.workunit.client.0.trial198.stderr:+ test max == max 2026-02-17T00:25:47.426 INFO:tasks.workunit.client.0.trial198.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T00:25:47.426 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 8a9c9989b4f4 cat /sys/fs/cgroup/pids/pids.max 2026-02-17T00:25:47.459 INFO:tasks.workunit.client.0.trial198.stderr:cat: /sys/fs/cgroup/pids/pids.max: No such file or directory 2026-02-17T00:25:47.462 INFO:tasks.workunit.client.0.trial198.stderr:+ '[' ']' 2026-02-17T00:25:47.463 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 8a9c9989b4f4 cat /sys/fs/cgroup/pids.max 2026-02-17T00:25:47.541 INFO:tasks.workunit.client.0.trial198.stderr:+ '[' max ']' 2026-02-17T00:25:47.542 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 8a9c9989b4f4 cat /sys/fs/cgroup/pids.max 2026-02-17T00:25:47.623 INFO:tasks.workunit.client.0.trial198.stderr:+ pid_limit=max 2026-02-17T00:25:47.623 INFO:tasks.workunit.client.0.trial198.stderr:+ test max == max 2026-02-17T00:25:47.623 INFO:tasks.workunit.client.0.trial198.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T00:25:47.623 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec 2d1981484e0f /bin/sh -c 'for j in {0..20000}; do sleep 300 & done' 2026-02-17T00:25:48.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:48 trial198 ceph-mon[39397]: pgmap v71: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:25:50.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:50 trial198 ceph-mon[39397]: pgmap v72: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T00:25:51.582 INFO:tasks.workunit.client.0.trial198.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T00:25:51.583 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec 8a9c9989b4f4 /bin/sh -c 'for j in {0..20000}; do sleep 300 & done' 2026-02-17T00:25:52.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:52 trial198 ceph-mon[39397]: pgmap v73: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:25:52.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:52 trial198 ceph-mon[39397]: from='client.14280 -' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T00:25:54.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:54 trial198 ceph-mon[39397]: pgmap v74: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:25:55.568 INFO:tasks.workunit.client.0.trial198.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T00:25:55.568 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 2d1981484e0f /bin/sh -c 'ps -ef | grep -c sleep' 2026-02-17T00:25:56.162 INFO:tasks.workunit.client.0.trial198.stderr:+ SLEEP_COUNT=20003 2026-02-17T00:25:56.162 INFO:tasks.workunit.client.0.trial198.stderr:+ test 20003 -gt 20000 2026-02-17T00:25:56.162 INFO:tasks.workunit.client.0.trial198.stderr:+ for i in ${ISCSI_CONT_IDS} 2026-02-17T00:25:56.162 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman exec 8a9c9989b4f4 /bin/sh -c 'ps -ef | grep -c sleep' 2026-02-17T00:25:56.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:56 trial198 ceph-mon[39397]: pgmap v75: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T00:25:56.761 INFO:tasks.workunit.client.0.trial198.stderr:+ SLEEP_COUNT=20003 2026-02-17T00:25:56.761 INFO:tasks.workunit.client.0.trial198.stderr:+ test 20003 -gt 20000 2026-02-17T00:25:56.761 INFO:tasks.workunit.client.0.trial198.stdout:OK 2026-02-17T00:25:56.761 INFO:tasks.workunit.client.0.trial198.stderr:+ echo OK 2026-02-17T00:25:56.762 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:25:56.762 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:25:56.827 INFO:tasks.workunit:Running workunits matching cephadm/test_iscsi_etc_hosts.sh on client.0... 2026-02-17T00:25:56.828 INFO:tasks.workunit:Running workunit cephadm/test_iscsi_etc_hosts.sh... 2026-02-17T00:25:56.828 DEBUG:teuthology.orchestra.run.trial198:workunit test cephadm/test_iscsi_etc_hosts.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=05b55d192f002ad5df41409624b8d176527d0841 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_etc_hosts.sh 2026-02-17T00:25:56.888 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo /home/ubuntu/cephtest/cephadm ls 2026-02-17T00:25:56.888 INFO:tasks.workunit.client.0.trial198.stderr:++ jq -r '.[] | select(.service_name == "iscsi.foo") | .name' 2026-02-17T00:25:57.481 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_DAEMON=iscsi.foo.trial198.roacgx 2026-02-17T00:25:57.482 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo /home/ubuntu/cephtest/cephadm enter --name iscsi.foo.trial198.roacgx -- cat /etc/hosts 2026-02-17T00:25:57.625 INFO:tasks.workunit.client.0.trial198.stderr:Inferring fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:25:57.736 INFO:tasks.workunit.client.0.trial198.stderr:+ cmp --silent /etc/hosts iscsi_daemon_etc_hosts.txt 2026-02-17T00:25:57.737 INFO:tasks.workunit.client.0.trial198.stderr:+ echo 'Daemon and host /etc/hosts files successfully matched' 2026-02-17T00:25:57.738 INFO:tasks.workunit.client.0.trial198.stdout:Daemon and host /etc/hosts files successfully matched 2026-02-17T00:25:57.738 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:25:57.739 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:25:57.804 INFO:tasks.workunit:Running workunits matching cephadm/test_iscsi_setup.sh on client.0... 2026-02-17T00:25:57.807 INFO:tasks.workunit:Running workunit cephadm/test_iscsi_setup.sh... 2026-02-17T00:25:57.807 DEBUG:teuthology.orchestra.run.trial198:workunit test cephadm/test_iscsi_setup.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=05b55d192f002ad5df41409624b8d176527d0841 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_setup.sh 2026-02-17T00:25:57.865 INFO:tasks.workunit.client.0.trial198.stderr:+ grep -q rhel /etc/centos-release /etc/os-release /etc/redhat-release /etc/system-release 2026-02-17T00:25:57.865 INFO:tasks.workunit.client.0.trial198.stderr:+ command -v cephadm 2026-02-17T00:25:57.866 INFO:tasks.workunit.client.0.trial198.stdout:/usr/sbin/cephadm 2026-02-17T00:25:57.866 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo ls /dev/disk/by-path 2026-02-17T00:25:57.866 INFO:tasks.workunit.client.0.trial198.stderr:+ grep iscsi 2026-02-17T00:25:57.875 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo dnf install jq -y 2026-02-17T00:25:58.169 INFO:tasks.workunit.client.0.trial198.stdout:Last metadata expiration check: 0:02:44 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:25:58.234 INFO:tasks.workunit.client.0.trial198.stdout:Package jq-1.6-19.el9.x86_64 is already installed. 2026-02-17T00:25:58.251 INFO:tasks.workunit.client.0.trial198.stdout:Dependencies resolved. 2026-02-17T00:25:58.252 INFO:tasks.workunit.client.0.trial198.stdout:Nothing to do. 2026-02-17T00:25:58.252 INFO:tasks.workunit.client.0.trial198.stdout:Complete! 2026-02-17T00:25:58.272 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo podman ps -qa --filter=name=iscsi 2026-02-17T00:25:58.272 INFO:tasks.workunit.client.0.trial198.stderr:++ head -n 1 2026-02-17T00:25:58.301 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_CONT_ID=2d1981484e0f 2026-02-17T00:25:58.301 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo cephadm ls --no-detail 2026-02-17T00:25:58.302 INFO:tasks.workunit.client.0.trial198.stderr:++ jq -r '.[] | select(.name | startswith("iscsi")) | .name' 2026-02-17T00:25:58.462 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_DAEMON_NAME=iscsi.foo.trial198.roacgx 2026-02-17T00:25:58.462 INFO:tasks.workunit.client.0.trial198.stderr:++ cut -d . -f2- 2026-02-17T00:25:58.462 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_DAEMON_ID=foo.trial198.roacgx 2026-02-17T00:25:58.463 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo cephadm shell -- ceph orch ps --daemon-id foo.trial198.roacgx -f json 2026-02-17T00:25:58.463 INFO:tasks.workunit.client.0.trial198.stderr:++ jq -r '.[] | .hostname' 2026-02-17T00:25:58.604 INFO:tasks.workunit.client.0.trial198.stderr:Inferring fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:25:58.648 INFO:tasks.workunit.client.0.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:58.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:25:58 trial198 ceph-mon[39397]: pgmap v76: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:25:58.731 INFO:tasks.workunit.client.0.trial198.stderr:Using ceph image with id 'dcf18b7f874c' and tag '05b55d192f002ad5df41409624b8d176527d0841' created on 2026-02-08 09:12:38 +0000 UTC 2026-02-17T00:25:58.731 INFO:tasks.workunit.client.0.trial198.stderr:quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-17T00:25:58.988 INFO:tasks.workunit.client.0.trial198.stderr:+ HOSTNAME=trial198 2026-02-17T00:25:58.988 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo cephadm shell -- ceph orch host ls --format json 2026-02-17T00:25:58.988 INFO:tasks.workunit.client.0.trial198.stderr:++ jq --arg HOSTNAME trial198 -r '.[] | select(.hostname == $HOSTNAME) | .addr' 2026-02-17T00:25:59.133 INFO:tasks.workunit.client.0.trial198.stderr:Inferring fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:25:59.176 INFO:tasks.workunit.client.0.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:59.258 INFO:tasks.workunit.client.0.trial198.stderr:Using ceph image with id 'dcf18b7f874c' and tag '05b55d192f002ad5df41409624b8d176527d0841' created on 2026-02-08 09:12:38 +0000 UTC 2026-02-17T00:25:59.258 INFO:tasks.workunit.client.0.trial198.stderr:quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-17T00:25:59.506 INFO:tasks.workunit.client.0.trial198.stderr:+ NODE_IP=10.20.193.198 2026-02-17T00:25:59.506 INFO:tasks.workunit.client.0.trial198.stderr:++ python3 -c 'import socket; print(socket.getfqdn())' 2026-02-17T00:25:59.520 INFO:tasks.workunit.client.0.trial198.stderr:+ FQDN=trial198 2026-02-17T00:25:59.520 INFO:tasks.workunit.client.0.trial198.stderr:++ python3 -c 'import socket; print(socket.getfqdn())' 2026-02-17T00:25:59.534 INFO:tasks.workunit.client.0.trial198.stderr:+ FQDN=trial198 2026-02-17T00:25:59.534 INFO:tasks.workunit.client.0.trial198.stderr:++ sudo cephadm shell -- ceph orch ls iscsi --format json 2026-02-17T00:25:59.534 INFO:tasks.workunit.client.0.trial198.stderr:++ jq -r '.[] | .spec | .pool' 2026-02-17T00:25:59.677 INFO:tasks.workunit.client.0.trial198.stderr:Inferring fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 2026-02-17T00:25:59.721 INFO:tasks.workunit.client.0.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:25:59.806 INFO:tasks.workunit.client.0.trial198.stderr:Using ceph image with id 'dcf18b7f874c' and tag '05b55d192f002ad5df41409624b8d176527d0841' created on 2026-02-08 09:12:38 +0000 UTC 2026-02-17T00:25:59.806 INFO:tasks.workunit.client.0.trial198.stderr:quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-17T00:26:00.051 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_POOL=foo 2026-02-17T00:26:00.051 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_USER=adminadmin 2026-02-17T00:26:00.051 INFO:tasks.workunit.client.0.trial198.stderr:+ ISCSI_PASSWORD=adminadminadmin 2026-02-17T00:26:00.051 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /iscsi-targets create iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw 2026-02-17T00:26:00.051 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /iscsi-targets create iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw 2026-02-17T00:26:00.541 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/gateways create trial198 10.20.193.198 2026-02-17T00:26:00.542 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/gateways create trial198 10.20.193.198 2026-02-17T00:26:00.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:00 trial198 ceph-mon[39397]: pgmap v77: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 1.2 KiB/s rd, 1 op/s 2026-02-17T00:26:00.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:00 trial198 ceph-mon[39397]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "daemon_id": "foo.trial198.roacgx", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:26:00.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:00 trial198 ceph-mon[39397]: from='client.14306 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:26:00.990 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /disks create pool=foo image=disk_1 size=2G 2026-02-17T00:26:00.991 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /disks create pool=foo image=disk_1 size=2G 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.14308 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "iscsi", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1116881867' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2420540777' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1908246087' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3062155234' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1931998303' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2506811244' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1571922509' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1022248764' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2310695568' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/497384497' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:01.578 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/121951217' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:01.579 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2624207890' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:01.579 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:01 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/78167772' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:01.589 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /disks create pool=foo image=disk_2 size=2G 2026-02-17T00:26:01.589 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /disks create pool=foo image=disk_2 size=2G 2026-02-17T00:26:02.221 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts create iqn.1994-05.com.redhat:client1 2026-02-17T00:26:02.221 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts create iqn.1994-05.com.redhat:client1 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: pgmap v78: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.14280 -' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2035370367' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/55996906' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3283583117' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3283583117' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3283583117' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2339405289' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/473258457' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2723230237' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2417850012' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3003615949' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1401610046' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/76509938' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/76509938' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/76509938' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/76509938' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist","blocklistop": "rm","addr": "10.20.193.198:0/3283583117"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1880099828' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:26:02.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:02 trial198 ceph-mon[39397]: from='mgr.14150 10.20.193.198:0/2537550104' entity='mgr.a' 2026-02-17T00:26:02.682 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 auth username=adminadmin password=adminadminadmin 2026-02-17T00:26:02.682 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 auth username=adminadmin password=adminadminadmin 2026-02-17T00:26:03.130 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_1 2026-02-17T00:26:03.130 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_1 2026-02-17T00:26:03.601 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3198624521' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:03.601 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/909035508' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4200613488' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1300152778' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3685530187' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1640843419' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2149185503' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4165214132' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4138594116' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:03.602 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:03 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3274278641' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:03.698 INFO:tasks.workunit.client.0.trial198.stderr:+ container_gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_2 2026-02-17T00:26:03.698 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo podman exec -it 2d1981484e0f gwcli /iscsi-targets/iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw/hosts/iqn.1994-05.com.redhat:client1 disk add foo/disk_2 2026-02-17T00:26:04.272 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo dnf install -y iscsi-initiator-utils device-mapper-multipath 2026-02-17T00:26:04.573 INFO:tasks.workunit.client.0.trial198.stdout:Last metadata expiration check: 0:02:50 ago on Tue 17 Feb 2026 12:23:14 AM UTC. 2026-02-17T00:26:04.636 INFO:tasks.workunit.client.0.trial198.stdout:Package iscsi-initiator-utils-6.2.1.11-0.git4b3e853.el9.x86_64 is already installed. 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout:Dependencies resolved. 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout:================================================================================ 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout: Package Arch Version Repository Size 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout:================================================================================ 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout:Installing: 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout: device-mapper-multipath x86_64 0.8.7-44.el9 baseos 156 k 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout:Upgrading: 2026-02-17T00:26:04.655 INFO:tasks.workunit.client.0.trial198.stdout: device-mapper-multipath-libs x86_64 0.8.7-44.el9 baseos 287 k 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout: kpartx x86_64 0.8.7-44.el9 baseos 49 k 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout: 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout:Transaction Summary 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout:================================================================================ 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout:Install 1 Package 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout:Upgrade 2 Packages 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout: 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout:Total download size: 492 k 2026-02-17T00:26:04.656 INFO:tasks.workunit.client.0.trial198.stdout:Downloading Packages: 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: pgmap v79: 33 pgs: 33 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 853 B/s rd, 0 op/s 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1283430929' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2935590714' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3078126599' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/58424449' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2662719462' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3661597132' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3661597132' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3661597132' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3661597132' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd blocklist","blocklistop": "rm","addr": "10.20.193.198:0/76509938"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2284451596' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "version"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/949228986' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/1891683901' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/4023996363' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/2252831112' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "df", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3326399935' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd pool get", "pool": "foo", "var": "crush_rule", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3326399935' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd", "format": "json"}]: dispatch 2026-02-17T00:26:04.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:04 trial198 ceph-mon[39397]: from='client.? 10.20.193.198:0/3326399935' entity='client.iscsi.foo.trial198.roacgx' cmd=[{"prefix": "osd crush rule ls-by-class", "class": "nvme", "format": "json"}]: dispatch 2026-02-17T00:26:04.808 INFO:tasks.workunit.client.0.trial198.stdout:(1/3): kpartx-0.8.7-44.el9.x86_64.rpm 760 kB/s | 49 kB 00:00 2026-02-17T00:26:04.827 INFO:tasks.workunit.client.0.trial198.stdout:(2/3): device-mapper-multipath-libs-0.8.7-44.el 3.4 MB/s | 287 kB 00:00 2026-02-17T00:26:04.828 INFO:tasks.workunit.client.0.trial198.stdout:(3/3): device-mapper-multipath-0.8.7-44.el9.x86 1.8 MB/s | 156 kB 00:00 2026-02-17T00:26:04.830 INFO:tasks.workunit.client.0.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:26:04.830 INFO:tasks.workunit.client.0.trial198.stdout:Total 2.8 MB/s | 492 kB 00:00 2026-02-17T00:26:04.856 INFO:tasks.workunit.client.0.trial198.stdout:Running transaction check 2026-02-17T00:26:04.864 INFO:tasks.workunit.client.0.trial198.stdout:Transaction check succeeded. 2026-02-17T00:26:04.864 INFO:tasks.workunit.client.0.trial198.stdout:Running transaction test 2026-02-17T00:26:04.903 INFO:tasks.workunit.client.0.trial198.stdout:Transaction test succeeded. 2026-02-17T00:26:04.903 INFO:tasks.workunit.client.0.trial198.stdout:Running transaction 2026-02-17T00:26:04.965 INFO:tasks.workunit.client.0.trial198.stdout: Preparing : 1/1 2026-02-17T00:26:04.977 INFO:tasks.workunit.client.0.trial198.stdout: Upgrading : kpartx-0.8.7-44.el9.x86_64 1/5 2026-02-17T00:26:04.985 INFO:tasks.workunit.client.0.trial198.stdout: Upgrading : device-mapper-multipath-libs-0.8.7-44.el9.x86_64 2/5 2026-02-17T00:26:04.986 INFO:tasks.workunit.client.0.trial198.stdout: Installing : device-mapper-multipath-0.8.7-44.el9.x86_64 3/5 2026-02-17T00:26:05.003 INFO:tasks.workunit.client.0.trial198.stdout: Running scriptlet: device-mapper-multipath-0.8.7-44.el9.x86_64 3/5 2026-02-17T00:26:05.003 INFO:tasks.workunit.client.0.trial198.stdout:Created symlink /etc/systemd/system/sysinit.target.wants/multipathd.service → /usr/lib/systemd/system/multipathd.service. 2026-02-17T00:26:05.003 INFO:tasks.workunit.client.0.trial198.stdout:Created symlink /etc/systemd/system/sockets.target.wants/multipathd.socket → /usr/lib/systemd/system/multipathd.socket. 2026-02-17T00:26:05.004 INFO:tasks.workunit.client.0.trial198.stdout: 2026-02-17T00:26:05.007 INFO:tasks.workunit.client.0.trial198.stdout: Cleanup : kpartx-0.8.7-39.el9.x86_64 4/5 2026-02-17T00:26:05.026 INFO:tasks.workunit.client.0.trial198.stdout: Cleanup : device-mapper-multipath-libs-0.8.7-39.el9.x86_64 5/5 2026-02-17T00:26:05.504 INFO:tasks.workunit.client.0.trial198.stdout: Running scriptlet: device-mapper-multipath-libs-0.8.7-39.el9.x86_64 5/5 2026-02-17T00:26:05.505 INFO:tasks.workunit.client.0.trial198.stdout: Verifying : device-mapper-multipath-0.8.7-44.el9.x86_64 1/5 2026-02-17T00:26:05.505 INFO:tasks.workunit.client.0.trial198.stdout: Verifying : device-mapper-multipath-libs-0.8.7-44.el9.x86_64 2/5 2026-02-17T00:26:05.505 INFO:tasks.workunit.client.0.trial198.stdout: Verifying : device-mapper-multipath-libs-0.8.7-39.el9.x86_64 3/5 2026-02-17T00:26:05.505 INFO:tasks.workunit.client.0.trial198.stdout: Verifying : kpartx-0.8.7-44.el9.x86_64 4/5 2026-02-17T00:26:05.568 INFO:tasks.workunit.client.0.trial198.stdout: Verifying : kpartx-0.8.7-39.el9.x86_64 5/5 2026-02-17T00:26:05.569 INFO:tasks.workunit.client.0.trial198.stdout: 2026-02-17T00:26:05.569 INFO:tasks.workunit.client.0.trial198.stdout:Upgraded: 2026-02-17T00:26:05.569 INFO:tasks.workunit.client.0.trial198.stdout: device-mapper-multipath-libs-0.8.7-44.el9.x86_64 kpartx-0.8.7-44.el9.x86_64 2026-02-17T00:26:05.569 INFO:tasks.workunit.client.0.trial198.stdout:Installed: 2026-02-17T00:26:05.569 INFO:tasks.workunit.client.0.trial198.stdout: device-mapper-multipath-0.8.7-44.el9.x86_64 2026-02-17T00:26:05.569 INFO:tasks.workunit.client.0.trial198.stdout: 2026-02-17T00:26:05.569 INFO:tasks.workunit.client.0.trial198.stdout:Complete! 2026-02-17T00:26:05.598 INFO:tasks.workunit.client.0.trial198.stderr:+ echo GenerateName=no 2026-02-17T00:26:05.598 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo tee /etc/iscsi/initiatorname.iscsi 2026-02-17T00:26:05.608 INFO:tasks.workunit.client.0.trial198.stdout:GenerateName=no 2026-02-17T00:26:05.609 INFO:tasks.workunit.client.0.trial198.stderr:+ echo InitiatorName=iqn.1994-05.com.redhat:client1 2026-02-17T00:26:05.609 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo tee -a /etc/iscsi/initiatorname.iscsi 2026-02-17T00:26:05.617 INFO:tasks.workunit.client.0.trial198.stdout:InitiatorName=iqn.1994-05.com.redhat:client1 2026-02-17T00:26:05.618 INFO:tasks.workunit.client.0.trial198.stderr:+ echo 'node.session.auth.authmethod = CHAP' 2026-02-17T00:26:05.619 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo tee -a /etc/iscsi/iscsid.conf 2026-02-17T00:26:05.626 INFO:tasks.workunit.client.0.trial198.stdout:node.session.auth.authmethod = CHAP 2026-02-17T00:26:05.628 INFO:tasks.workunit.client.0.trial198.stderr:+ echo 'node.session.auth.username = adminadmin' 2026-02-17T00:26:05.628 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo tee -a /etc/iscsi/iscsid.conf 2026-02-17T00:26:05.635 INFO:tasks.workunit.client.0.trial198.stdout:node.session.auth.username = adminadmin 2026-02-17T00:26:05.637 INFO:tasks.workunit.client.0.trial198.stderr:+ echo 'node.session.auth.password = adminadminadmin' 2026-02-17T00:26:05.637 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo tee -a /etc/iscsi/iscsid.conf 2026-02-17T00:26:05.644 INFO:tasks.workunit.client.0.trial198.stdout:node.session.auth.password = adminadminadmin 2026-02-17T00:26:05.645 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo tee -a /etc/multipath.conf 2026-02-17T00:26:05.654 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo systemctl restart multipathd 2026-02-17T00:26:05.766 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo systemctl restart iscsid 2026-02-17T00:26:05.819 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo iscsiadm -m discovery -t st -p 10.20.193.198 2026-02-17T00:26:05.845 INFO:tasks.workunit.client.0.trial198.stdout:10.20.193.198:3260,1 iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw 2026-02-17T00:26:05.846 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo iscsiadm -m node -T iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw -l 2026-02-17T00:26:05.906 INFO:tasks.workunit.client.0.trial198.stdout:Login to [iface: default, target: iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw, portal: 10.20.193.198,3260] successful. 2026-02-17T00:26:05.907 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo iscsiadm -m session --rescan 2026-02-17T00:26:05.965 INFO:tasks.workunit.client.0.trial198.stdout:Rescanning session [sid: 1, target: iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw, portal: 10.20.193.198,3260] 2026-02-17T00:26:05.972 INFO:tasks.workunit.client.0.trial198.stderr:+ sleep 5 2026-02-17T00:26:06.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:06 trial198 ceph-mon[39397]: pgmap v80: 33 pgs: 33 active+clean; 580 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail; 45 KiB/s rd, 1.8 KiB/s wr, 51 op/s 2026-02-17T00:26:08.706 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:08 trial198 ceph-mon[39397]: pgmap v81: 33 pgs: 33 active+clean; 580 KiB data, 86 MiB used, 2.1 TiB / 2.1 TiB avail; 47 KiB/s rd, 2.1 KiB/s wr, 55 op/s 2026-02-17T00:26:10.705 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:10 trial198 ceph-mon[39397]: pgmap v82: 33 pgs: 33 active+clean; 580 KiB data, 86 MiB used, 2.1 TiB / 2.1 TiB avail; 70 KiB/s rd, 3.4 KiB/s wr, 79 op/s 2026-02-17T00:26:10.975 INFO:tasks.workunit.client.0.trial198.stderr:+ sudo ls /dev/disk/by-path 2026-02-17T00:26:10.976 INFO:tasks.workunit.client.0.trial198.stderr:+ grep iscsi 2026-02-17T00:26:10.987 INFO:tasks.workunit.client.0.trial198.stdout:ip-10.20.193.198:3260-iscsi-iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw-lun-0 2026-02-17T00:26:10.987 INFO:tasks.workunit.client.0.trial198.stdout:ip-10.20.193.198:3260-iscsi-iqn.2003-01.com.redhat.iscsi-gw:iscsi-igw-lun-1 2026-02-17T00:26:10.987 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:26:10.988 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:26:11.052 INFO:tasks.workunit:Stopping ['cephadm/test_iscsi_pids_limit.sh', 'cephadm/test_iscsi_etc_hosts.sh', 'cephadm/test_iscsi_setup.sh'] on client.0... 2026-02-17T00:26:11.052 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T00:26:11.393 DEBUG:teuthology.parallel:result is None 2026-02-17T00:26:11.393 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T00:26:11.419 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T00:26:11.419 DEBUG:teuthology.orchestra.run.trial198:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:26:11.476 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T00:26:11.476 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-17T00:26:11.492 INFO:tasks.cephadm:Teardown begin 2026-02-17T00:26:11.492 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:26:11.539 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-17T00:26:11.539 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-17T00:26:11.745 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/f2b6e4ff-0b96-11f1-955f-d404e6e7d460/mon.a/config 2026-02-17T00:26:11.763 INFO:teuthology.orchestra.run.trial198.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-17T00:26:11.783 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-17T00:26:11.784 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-17T00:26:11.784 DEBUG:teuthology.orchestra.run.trial198:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-17T00:26:11.800 INFO:tasks.cephadm:Stopping all daemons... 2026-02-17T00:26:11.800 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-17T00:26:11.801 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a 2026-02-17T00:26:12.044 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:11 trial198 systemd[1]: Stopping Ceph mon.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460... 2026-02-17T00:26:12.045 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a[39393]: 2026-02-17T00:26:11.949+0000 7fc9977bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:26:12.045 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:11 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a[39393]: 2026-02-17T00:26:11.949+0000 7fc9977bc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T00:26:12.133 DEBUG:teuthology.orchestra.run.trial198:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service' 2026-02-17T00:26:12.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:12 trial198 podman[108237]: 2026-02-17 00:26:12.041436983 +0000 UTC m=+0.107846761 container died e4b71ca592a01f993870a3841c51ebc88b094a9163c7f7cf76a72215873152df (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.build-date=20260202, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-17T00:26:12.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:12 trial198 podman[108237]: 2026-02-17 00:26:12.050547868 +0000 UTC m=+0.116957636 container remove e4b71ca592a01f993870a3841c51ebc88b094a9163c7f7cf76a72215873152df (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-17T00:26:12.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:12 trial198 bash[108237]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mon-a 2026-02-17T00:26:12.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:12 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-17T00:26:12.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:12 trial198 systemd[1]: Stopped Ceph mon.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:26:12.456 INFO:journalctl@ceph.mon.a.trial198.stdout:Feb 17 00:26:12 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mon.a.service: Consumed 2.386s CPU time. 2026-02-17T00:26:13.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T00:26:13.064 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-17T00:26:13.064 INFO:tasks.cephadm.mgr.a:Stopping mgr.a... 2026-02-17T00:26:13.064 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a 2026-02-17T00:26:13.313 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 systemd[1]: Stopping Ceph mgr.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460... 2026-02-17T00:26:13.313 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a[39649]: 2026-02-17T00:26:13.169+0000 7f26f9bc7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:26:13.314 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 podman[108393]: 2026-02-17 00:26:13.210391699 +0000 UTC m=+0.053447629 container died fec3997ddda73f4d8818023f22fcbcbadb469c2b445dde1ae646977cfdd4cda7 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a, org.label-schema.build-date=20260202, CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0) 2026-02-17T00:26:13.314 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 podman[108393]: 2026-02-17 00:26:13.236019318 +0000 UTC m=+0.079075248 container remove fec3997ddda73f4d8818023f22fcbcbadb469c2b445dde1ae646977cfdd4cda7 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-17T00:26:13.314 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 bash[108393]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-mgr-a 2026-02-17T00:26:13.314 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a.service: Deactivated successfully. 2026-02-17T00:26:13.316 DEBUG:teuthology.orchestra.run.trial198:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a.service' 2026-02-17T00:26:13.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 systemd[1]: Stopped Ceph mgr.a for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:26:13.706 INFO:journalctl@ceph.mgr.a.trial198.stdout:Feb 17 00:26:13 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@mgr.a.service: Consumed 14.236s CPU time. 2026-02-17T00:26:14.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T00:26:14.129 INFO:tasks.cephadm.mgr.a:Stopped mgr.a 2026-02-17T00:26:14.129 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-17T00:26:14.129 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.0 2026-02-17T00:26:14.456 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:14 trial198 systemd[1]: Stopping Ceph osd.0 for f2b6e4ff-0b96-11f1-955f-d404e6e7d460... 2026-02-17T00:26:14.456 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:14 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0[48541]: 2026-02-17T00:26:14.238+0000 7f834624d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:26:14.456 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:14 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0[48541]: 2026-02-17T00:26:14.238+0000 7f834624d640 -1 osd.0 35 *** Got signal Terminated *** 2026-02-17T00:26:14.457 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:14 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0[48541]: 2026-02-17T00:26:14.238+0000 7f834624d640 -1 osd.0 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T00:26:19.927 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108549]: 2026-02-17 00:26:19.632009022 +0000 UTC m=+5.406332659 container died 307e86768e098eaeb5ec601860b575393e10639604ce689b9c942781caa78d32 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, io.buildah.version=1.33.7) 2026-02-17T00:26:19.927 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108549]: 2026-02-17 00:26:19.641781 +0000 UTC m=+5.416104637 container remove 307e86768e098eaeb5ec601860b575393e10639604ce689b9c942781caa78d32 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.build-date=20260202, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, io.buildah.version=1.33.7) 2026-02-17T00:26:19.927 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 bash[108549]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0 2026-02-17T00:26:19.927 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108683]: 2026-02-17 00:26:19.830352175 +0000 UTC m=+0.015898644 container create c2f73c9899be8533c83be98c2dd95db11b30a4e2e17934004a34bb8087b41cfa (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260202, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.7) 2026-02-17T00:26:19.928 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108683]: 2026-02-17 00:26:19.869909307 +0000 UTC m=+0.055455776 container init c2f73c9899be8533c83be98c2dd95db11b30a4e2e17934004a34bb8087b41cfa (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0-deactivate, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202) 2026-02-17T00:26:19.928 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108683]: 2026-02-17 00:26:19.872451483 +0000 UTC m=+0.057997952 container start c2f73c9899be8533c83be98c2dd95db11b30a4e2e17934004a34bb8087b41cfa (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0-deactivate, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260202, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default) 2026-02-17T00:26:19.928 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108683]: 2026-02-17 00:26:19.872905285 +0000 UTC m=+0.058451744 container attach c2f73c9899be8533c83be98c2dd95db11b30a4e2e17934004a34bb8087b41cfa (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-17T00:26:19.928 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108683]: 2026-02-17 00:26:19.824092353 +0000 UTC m=+0.009638822 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-17T00:26:20.035 DEBUG:teuthology.orchestra.run.trial198:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.0.service' 2026-02-17T00:26:20.206 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:19 trial198 podman[108683]: 2026-02-17 00:26:19.997439537 +0000 UTC m=+0.182985996 container died c2f73c9899be8533c83be98c2dd95db11b30a4e2e17934004a34bb8087b41cfa (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0-deactivate, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T00:26:20.206 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:20 trial198 podman[108683]: 2026-02-17 00:26:20.007880245 +0000 UTC m=+0.193426714 container remove c2f73c9899be8533c83be98c2dd95db11b30a4e2e17934004a34bb8087b41cfa (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202) 2026-02-17T00:26:20.206 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:20 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.0.service: Deactivated successfully. 2026-02-17T00:26:20.207 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:20 trial198 systemd[1]: Stopped Ceph osd.0 for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:26:20.207 INFO:journalctl@ceph.osd.0.trial198.stdout:Feb 17 00:26:20 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.0.service: Consumed 2.082s CPU time. 2026-02-17T00:26:20.848 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T00:26:20.849 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-17T00:26:20.849 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-17T00:26:20.849 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.1 2026-02-17T00:26:21.206 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:20 trial198 systemd[1]: Stopping Ceph osd.1 for f2b6e4ff-0b96-11f1-955f-d404e6e7d460... 2026-02-17T00:26:21.206 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:20 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1[52408]: 2026-02-17T00:26:20.951+0000 7f0cd61cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:26:21.206 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:20 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1[52408]: 2026-02-17T00:26:20.951+0000 7f0cd61cc640 -1 osd.1 35 *** Got signal Terminated *** 2026-02-17T00:26:21.206 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:20 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1[52408]: 2026-02-17T00:26:20.951+0000 7f0cd61cc640 -1 osd.1 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T00:26:26.618 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[108818]: 2026-02-17 00:26:26.338557627 +0000 UTC m=+5.399523722 container died e8267ccc6aa02dc4eb73c7d32c3ab9c747cf55cd34dbb6a3021da4b227bdb3f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, ceph=True) 2026-02-17T00:26:26.619 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[108818]: 2026-02-17 00:26:26.34867239 +0000 UTC m=+5.409638486 container remove e8267ccc6aa02dc4eb73c7d32c3ab9c747cf55cd34dbb6a3021da4b227bdb3f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.build-date=20260202, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.license=GPLv2, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-02-17T00:26:26.619 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 bash[108818]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1 2026-02-17T00:26:26.619 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[109559]: 2026-02-17 00:26:26.522343445 +0000 UTC m=+0.015864160 container create 992345ed05af6b6ba08c6d0e0149d16eed04e91cae72b020693d96620d780182 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.build-date=20260202, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-17T00:26:26.619 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[109559]: 2026-02-17 00:26:26.561244089 +0000 UTC m=+0.054764794 container init 992345ed05af6b6ba08c6d0e0149d16eed04e91cae72b020693d96620d780182 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1-deactivate, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T00:26:26.619 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[109559]: 2026-02-17 00:26:26.563915966 +0000 UTC m=+0.057436681 container start 992345ed05af6b6ba08c6d0e0149d16eed04e91cae72b020693d96620d780182 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=wip-squid-pr-67199-kefu-1, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7) 2026-02-17T00:26:26.619 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[109559]: 2026-02-17 00:26:26.564380888 +0000 UTC m=+0.057901614 container attach 992345ed05af6b6ba08c6d0e0149d16eed04e91cae72b020693d96620d780182 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS) 2026-02-17T00:26:26.619 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[109559]: 2026-02-17 00:26:26.515592462 +0000 UTC m=+0.009113177 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-17T00:26:26.729 DEBUG:teuthology.orchestra.run.trial198:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.1.service' 2026-02-17T00:26:26.956 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[109559]: 2026-02-17 00:26:26.68148166 +0000 UTC m=+0.175002385 container died 992345ed05af6b6ba08c6d0e0149d16eed04e91cae72b020693d96620d780182 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, ceph=True, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-17T00:26:26.956 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 podman[109559]: 2026-02-17 00:26:26.694167504 +0000 UTC m=+0.187688209 container remove 992345ed05af6b6ba08c6d0e0149d16eed04e91cae72b020693d96620d780182 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-17T00:26:26.956 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.1.service: Deactivated successfully. 2026-02-17T00:26:26.956 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 systemd[1]: Stopped Ceph osd.1 for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:26:26.956 INFO:journalctl@ceph.osd.1.trial198.stdout:Feb 17 00:26:26 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.1.service: Consumed 2.050s CPU time. 2026-02-17T00:26:27.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T00:26:27.542 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-17T00:26:27.542 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-17T00:26:27.542 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.2 2026-02-17T00:26:27.956 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:27 trial198 systemd[1]: Stopping Ceph osd.2 for f2b6e4ff-0b96-11f1-955f-d404e6e7d460... 2026-02-17T00:26:27.956 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:27 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2[55889]: 2026-02-17T00:26:27.648+0000 7fe6dd4e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:26:27.956 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:27 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2[55889]: 2026-02-17T00:26:27.648+0000 7fe6dd4e9640 -1 osd.2 35 *** Got signal Terminated *** 2026-02-17T00:26:27.956 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:27 trial198 ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2[55889]: 2026-02-17T00:26:27.648+0000 7fe6dd4e9640 -1 osd.2 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T00:26:33.354 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109696]: 2026-02-17 00:26:33.091662789 +0000 UTC m=+5.456047169 container died de37068ba8b02bc3b248ffe1d9b68b6a65eb70240d421807eb7186d48c0f6c74 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default) 2026-02-17T00:26:33.354 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109696]: 2026-02-17 00:26:33.100702518 +0000 UTC m=+5.465086888 container remove de37068ba8b02bc3b248ffe1d9b68b6a65eb70240d421807eb7186d48c0f6c74 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, OSD_FLAVOR=default) 2026-02-17T00:26:33.355 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 bash[109696]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2 2026-02-17T00:26:33.355 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109825]: 2026-02-17 00:26:33.259110348 +0000 UTC m=+0.016522281 container create 76eb382ffe4213c67f510b8bef25dfbfb0e5cc40395f6dde49265ff48cacff4c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.7, org.label-schema.license=GPLv2) 2026-02-17T00:26:33.355 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109825]: 2026-02-17 00:26:33.300820925 +0000 UTC m=+0.058232858 container init 76eb382ffe4213c67f510b8bef25dfbfb0e5cc40395f6dde49265ff48cacff4c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7) 2026-02-17T00:26:33.355 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109825]: 2026-02-17 00:26:33.303338295 +0000 UTC m=+0.060750228 container start 76eb382ffe4213c67f510b8bef25dfbfb0e5cc40395f6dde49265ff48cacff4c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841) 2026-02-17T00:26:33.355 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109825]: 2026-02-17 00:26:33.30405246 +0000 UTC m=+0.061464393 container attach 76eb382ffe4213c67f510b8bef25dfbfb0e5cc40395f6dde49265ff48cacff4c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T00:26:33.355 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109825]: 2026-02-17 00:26:33.251868815 +0000 UTC m=+0.009280748 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-17T00:26:33.468 DEBUG:teuthology.orchestra.run.trial198:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.2.service' 2026-02-17T00:26:33.706 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109825]: 2026-02-17 00:26:33.424050717 +0000 UTC m=+0.181462650 container died 76eb382ffe4213c67f510b8bef25dfbfb0e5cc40395f6dde49265ff48cacff4c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260202, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-17T00:26:33.706 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 podman[109825]: 2026-02-17 00:26:33.434410485 +0000 UTC m=+0.191822408 container remove 76eb382ffe4213c67f510b8bef25dfbfb0e5cc40395f6dde49265ff48cacff4c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-17T00:26:33.706 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.2.service: Deactivated successfully. 2026-02-17T00:26:33.706 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 systemd[1]: Stopped Ceph osd.2 for f2b6e4ff-0b96-11f1-955f-d404e6e7d460. 2026-02-17T00:26:33.706 INFO:journalctl@ceph.osd.2.trial198.stdout:Feb 17 00:26:33 trial198 systemd[1]: ceph-f2b6e4ff-0b96-11f1-955f-d404e6e7d460@osd.2.service: Consumed 2.324s CPU time. 2026-02-17T00:26:34.277 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T00:26:34.278 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-17T00:26:34.278 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2b6e4ff-0b96-11f1-955f-d404e6e7d460 --force --keep-logs 2026-02-17T06:18:01.232 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2026-02-17T06:18:01.246 DEBUG:teuthology.task.console_log:Killing console logger for trial198 2026-02-17T06:18:01.247 DEBUG:teuthology.exit:Finished running handlers