2026-02-26T02:49:21.842 INFO:root:teuthology version: 1.2.4.dev11+g6e3d0419c 2026-02-26T02:49:21.858 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T02:49:21.934 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095 branch: wip-yuri9-testing-2026-02-25-1600-squid description: rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '71095' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri9-testing-2026-02-25-1600-squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-only-match: - CEPHADM_ sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: use-ca-signed-key: true install: ceph: flavor: default sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri9-testing-2026-02-25-1600-squid sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - mon.a - mgr.a - osd.0 - client.0 - - host.b - mon.b - mgr.b - osd.1 - client.1 seed: 1525 sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri9-testing-2026-02-25-1600-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 targets: trial190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCA/x+UTyDppfZqje7RrPcaoin/XIdZHeohYZ4jthTBouzeIw5cbqEuYLEE6+FeXYZaMhgxRnmB9A2F/bR8JItc= trial191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLDAFmsxiCLPwMsJODlBySrXkMuFkZExzpahkuDjNJ1GLZeVHMvRW0lSFm+8/FZWbuWhq2Kvm8Im2zLfKlrOh1k= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - install: null - cephadm: null - cephadm.shell: host.a: - "set -ex\nHOSTNAMES=$(ceph orch host ls --format json | jq -r '.[] | .hostname')\n\ for host in $HOSTNAMES; do\n # do a check-host on each host to make sure it's\ \ reachable\n ceph cephadm check-host ${host} 2> ${host}-ok.txt\n HOST_OK=$(cat\ \ ${host}-ok.txt)\n if ! grep -q \"Host looks OK\" <<< \"$HOST_OK\"; then\n\ \ printf \"Failed host check:\\n\\n$HOST_OK\"\n exit 1\n fi\ndone\n" teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6e3d0419ccca0e75a03e08feb708946e198236f4 timestamp: 2026-02-26_01:51:16 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-26T02:49:21.934 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa; will attempt to use it 2026-02-26T02:49:21.935 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks 2026-02-26T02:49:21.935 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-26T02:49:21.937 INFO:teuthology.task.internal:Checking packages... 2026-02-26T02:49:21.937 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5' 2026-02-26T02:49:21.937 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-26T02:49:21.937 INFO:teuthology.packaging:ref: None 2026-02-26T02:49:21.937 INFO:teuthology.packaging:tag: None 2026-02-26T02:49:21.937 INFO:teuthology.packaging:branch: wip-yuri9-testing-2026-02-25-1600-squid 2026-02-26T02:49:21.937 INFO:teuthology.packaging:sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:49:21.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri9-testing-2026-02-25-1600-squid 2026-02-26T02:49:22.054 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-687.g8d724284 2026-02-26T02:49:22.056 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-26T02:49:22.068 INFO:teuthology.task.internal:no buildpackages task found 2026-02-26T02:49:22.068 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-26T02:49:22.081 INFO:teuthology.task.internal:Saving configuration 2026-02-26T02:49:22.098 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-26T02:49:22.110 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-26T02:49:22.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial190.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-26 02:45:50.226048', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCA/x+UTyDppfZqje7RrPcaoin/XIdZHeohYZ4jthTBouzeIw5cbqEuYLEE6+FeXYZaMhgxRnmB9A2F/bR8JItc='} 2026-02-26T02:49:22.243 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial191.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-26 02:45:50.226663', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLDAFmsxiCLPwMsJODlBySrXkMuFkZExzpahkuDjNJ1GLZeVHMvRW0lSFm+8/FZWbuWhq2Kvm8Im2zLfKlrOh1k='} 2026-02-26T02:49:22.243 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-26T02:49:22.255 INFO:teuthology.task.internal:roles: ubuntu@trial190.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.a', 'osd.0', 'client.0'] 2026-02-26T02:49:22.255 INFO:teuthology.task.internal:roles: ubuntu@trial191.front.sepia.ceph.com - ['host.b', 'mon.b', 'mgr.b', 'osd.1', 'client.1'] 2026-02-26T02:49:22.255 INFO:teuthology.run_tasks:Running task console_log... 2026-02-26T02:49:22.387 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72ec7f822200>, signals=[15]) 2026-02-26T02:49:22.387 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-26T02:49:22.404 INFO:teuthology.task.internal:Opening connections... 2026-02-26T02:49:22.404 DEBUG:teuthology.task.internal:connecting to ubuntu@trial190.front.sepia.ceph.com 2026-02-26T02:49:22.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:49:22.468 DEBUG:teuthology.task.internal:connecting to ubuntu@trial191.front.sepia.ceph.com 2026-02-26T02:49:22.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:49:22.530 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-26T02:49:22.542 DEBUG:teuthology.orchestra.run.trial190:> uname -m 2026-02-26T02:49:22.558 INFO:teuthology.orchestra.run.trial190.stdout:x86_64 2026-02-26T02:49:22.558 DEBUG:teuthology.orchestra.run.trial190:> cat /etc/os-release 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:NAME="CentOS Stream" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:VERSION="9" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:ID="centos" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:ID_LIKE="rhel fedora" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:VERSION_ID="9" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:PLATFORM_ID="platform:el9" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:ANSI_COLOR="0;31" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:LOGO="fedora-logo-icon" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:HOME_URL="https://centos.org/" 2026-02-26T02:49:22.613 INFO:teuthology.orchestra.run.trial190.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T02:49:22.614 INFO:teuthology.orchestra.run.trial190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T02:49:22.614 INFO:teuthology.orchestra.run.trial190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T02:49:22.614 INFO:teuthology.lock.ops:Updating trial190.front.sepia.ceph.com on lock server 2026-02-26T02:49:22.679 DEBUG:teuthology.orchestra.run.trial191:> uname -m 2026-02-26T02:49:22.694 INFO:teuthology.orchestra.run.trial191.stdout:x86_64 2026-02-26T02:49:22.694 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/" 2026-02-26T02:49:22.750 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T02:49:22.751 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T02:49:22.751 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T02:49:22.751 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server 2026-02-26T02:49:22.821 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-26T02:49:22.833 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-26T02:49:22.845 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-26T02:49:22.845 DEBUG:teuthology.orchestra.run.trial190:> test '!' -e /home/ubuntu/cephtest 2026-02-26T02:49:22.846 DEBUG:teuthology.orchestra.run.trial191:> test '!' -e /home/ubuntu/cephtest 2026-02-26T02:49:22.861 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-26T02:49:22.872 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-26T02:49:22.872 DEBUG:teuthology.orchestra.run.trial190:> test -z $(ls -A /var/lib/ceph) 2026-02-26T02:49:22.903 DEBUG:teuthology.orchestra.run.trial191:> test -z $(ls -A /var/lib/ceph) 2026-02-26T02:49:22.920 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-26T02:49:23.075 INFO:teuthology.run_tasks:Running task kernel... 2026-02-26T02:49:23.097 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-26T02:49:23.098 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-26T02:49:23.098 DEBUG:teuthology.orchestra.run.trial190:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-26T02:49:23.098 DEBUG:teuthology.orchestra.run.trial191:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-26T02:49:23.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:49:23.112 DEBUG:teuthology.orchestra.run.trial190:> uname -r 2026-02-26T02:49:23.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:49:23.113 DEBUG:teuthology.orchestra.run.trial191:> uname -r 2026-02-26T02:49:23.168 INFO:teuthology.orchestra.run.trial191.stdout:5.14.0-681.el9.x86_64 2026-02-26T02:49:23.168 INFO:teuthology.task.kernel:Running kernel on trial191: 5.14.0-681.el9.x86_64 2026-02-26T02:49:23.168 DEBUG:teuthology.orchestra.run.trial191:> sudo yum install -y kernel 2026-02-26T02:49:23.168 INFO:teuthology.orchestra.run.trial190.stdout:5.14.0-681.el9.x86_64 2026-02-26T02:49:23.169 INFO:teuthology.task.kernel:Running kernel on trial190: 5.14.0-681.el9.x86_64 2026-02-26T02:49:23.169 DEBUG:teuthology.orchestra.run.trial190:> sudo yum install -y kernel 2026-02-26T02:49:31.761 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-26T02:49:32.052 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-26T02:49:32.711 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - AppStream 63 MB/s | 27 MB 00:00 2026-02-26T02:49:35.766 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 27 MB 00:03 2026-02-26T02:49:40.613 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 8.0 MB 00:02 2026-02-26T02:49:44.200 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - CRB 893 kB/s | 8.0 MB 00:09 2026-02-26T02:49:45.036 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - Extras packages 210 kB/s | 20 kB 00:00 2026-02-26T02:49:46.321 INFO:teuthology.orchestra.run.trial190.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-26T02:49:49.457 INFO:teuthology.orchestra.run.trial190.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-26T02:49:50.491 INFO:teuthology.orchestra.run.trial190.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-26T02:49:50.491 INFO:teuthology.orchestra.run.trial190.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-26T02:49:50.511 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:49:50.512 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:49:50.512 INFO:teuthology.orchestra.run.trial190.stdout: Package Architecture Version Repository Size 2026-02-26T02:49:50.512 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:49:50.512 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:49:50.512 INFO:teuthology.orchestra.run.trial190.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout:Installing dependencies: 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout:Install 4 Packages 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 89 M 2026-02-26T02:49:50.513 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 135 M 2026-02-26T02:49:50.514 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:49:50.917 INFO:teuthology.orchestra.run.trial190.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 5.7 MB/s | 901 kB 00:00 2026-02-26T02:49:51.102 INFO:teuthology.orchestra.run.trial190.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 51 MB/s | 17 MB 00:00 2026-02-26T02:49:51.257 INFO:teuthology.orchestra.run.trial190.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 91 MB/s | 31 MB 00:00 2026-02-26T02:49:51.334 INFO:teuthology.orchestra.run.trial190.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 70 MB/s | 40 MB 00:00 2026-02-26T02:49:51.335 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:49:51.335 INFO:teuthology.orchestra.run.trial190.stdout:Total 108 MB/s | 89 MB 00:00 2026-02-26T02:49:51.528 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:49:51.730 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:49:51.730 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:49:52.115 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:49:52.115 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:49:53.228 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:49:53.516 INFO:teuthology.orchestra.run.trial190.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:49:53.538 INFO:teuthology.orchestra.run.trial190.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:49:56.108 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:49:56.140 INFO:teuthology.orchestra.run.trial190.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:49:59.358 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:49:59.365 INFO:teuthology.orchestra.run.trial190.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:02.415 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:12.273 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - Extras packages 667 B/s | 20 kB 00:30 2026-02-26T02:50:13.520 INFO:teuthology.orchestra.run.trial191.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-26T02:50:16.671 INFO:teuthology.orchestra.run.trial191.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-26T02:50:17.702 INFO:teuthology.orchestra.run.trial191.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-26T02:50:17.702 INFO:teuthology.orchestra.run.trial191.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-26T02:50:17.722 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout: Package Architecture Version Repository Size 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout:Installing dependencies: 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout:Install 4 Packages 2026-02-26T02:50:17.723 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:50:17.724 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 89 M 2026-02-26T02:50:17.724 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 135 M 2026-02-26T02:50:17.724 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:50:18.161 INFO:teuthology.orchestra.run.trial191.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 6.6 MB/s | 901 kB 00:00 2026-02-26T02:50:18.754 INFO:teuthology.orchestra.run.trial191.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 24 MB/s | 17 MB 00:00 2026-02-26T02:50:19.312 INFO:teuthology.orchestra.run.trial191.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 27 MB/s | 31 MB 00:01 2026-02-26T02:50:19.570 INFO:teuthology.orchestra.run.trial191.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 26 MB/s | 40 MB 00:01 2026-02-26T02:50:19.570 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:50:19.570 INFO:teuthology.orchestra.run.trial191.stdout:Total 48 MB/s | 89 MB 00:01 2026-02-26T02:50:19.761 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:50:19.826 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:19.849 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:19.963 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:50:19.964 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:50:20.037 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:20.037 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:50:20.037 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:50:20.037 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:50:20.095 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:20.095 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:50:20.095 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:50:20.095 INFO:teuthology.orchestra.run.trial190.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.095 INFO:teuthology.orchestra.run.trial190.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.095 INFO:teuthology.orchestra.run.trial190.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.095 INFO:teuthology.orchestra.run.trial190.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.096 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:50:20.096 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:50:20.157 DEBUG:teuthology.orchestra.run.trial190:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:50:20.185 INFO:teuthology.orchestra.run.trial190.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.186 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:50:20.186 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-26T02:50:20.186 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-26T02:50:20.186 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-26T02:50:20.186 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-26T02:50:20.187 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial190.front.sepia.ceph.com, path=None, version=distro) 2026-02-26T02:50:20.187 DEBUG:teuthology.orchestra.run.trial190:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:50:20.253 INFO:teuthology.orchestra.run.trial190.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.254 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:50:20.254 DEBUG:teuthology.orchestra.run.trial190:> sudo rpm -qi grub2-tools 2026-02-26T02:50:20.323 INFO:teuthology.orchestra.run.trial190.stdout:Name : grub2-tools 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Epoch : 1 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Version : 2.06 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Release : 120.el9 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Architecture: x86_64 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Group : Unspecified 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Size : 9108611 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:License : GPLv3+ 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Packager : builder@centos.org 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Vendor : CentOS 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Summary : Support tools for GRUB. 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:Description : 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:hardware devices. 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:50:20.324 INFO:teuthology.orchestra.run.trial190.stdout:This subpackage provides tools for support of all platforms. 2026-02-26T02:50:20.326 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-26T02:50:20.326 INFO:teuthology.task.kernel:Updating grub on trial190 to boot 5.14.0-686.el9.x86_64 2026-02-26T02:50:20.326 DEBUG:teuthology.orchestra.run.trial190:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-26T02:50:20.346 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:50:20.346 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:50:20.388 INFO:teuthology.orchestra.run.trial190.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-26T02:50:20.389 DEBUG:teuthology.orchestra.run.trial190:> sudo command -v grubby && echo yes || echo no 2026-02-26T02:50:20.452 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/grubby 2026-02-26T02:50:20.454 INFO:teuthology.orchestra.run.trial190.stdout:yes 2026-02-26T02:50:20.454 DEBUG:teuthology.orchestra.run.trial190:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-26T02:50:20.518 INFO:teuthology.orchestra.run.trial190.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-26T02:50:20.519 DEBUG:teuthology.orchestra.run.trial190:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.591 DEBUG:teuthology.orchestra.run.trial190:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-26T02:50:20.794 INFO:teuthology.orchestra.run.trial190.stderr:Generating grub configuration file ... 2026-02-26T02:50:20.860 INFO:teuthology.orchestra.run.trial190.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-26T02:50:20.867 INFO:teuthology.orchestra.run.trial190.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-26T02:50:21.116 INFO:teuthology.orchestra.run.trial190.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-26T02:50:21.123 INFO:teuthology.orchestra.run.trial190.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-26T02:50:21.157 INFO:teuthology.orchestra.run.trial190.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-26T02:50:21.163 INFO:teuthology.orchestra.run.trial190.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-26T02:50:21.195 INFO:teuthology.orchestra.run.trial190.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-26T02:50:21.202 INFO:teuthology.orchestra.run.trial190.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-26T02:50:21.225 INFO:teuthology.orchestra.run.trial190.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-26T02:50:21.232 INFO:teuthology.orchestra.run.trial190.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-26T02:50:21.318 INFO:teuthology.orchestra.run.trial190.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-26T02:50:21.327 INFO:teuthology.orchestra.run.trial190.stderr:done 2026-02-26T02:50:21.329 DEBUG:teuthology.orchestra.run.trial190:> test -d /sys/firmware/efi 2026-02-26T02:50:21.345 DEBUG:teuthology.orchestra.run.trial190:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-26T02:50:21.413 INFO:teuthology.orchestra.run.trial190.stdout:/boot/efi/EFI/BOOT 2026-02-26T02:50:21.413 INFO:teuthology.orchestra.run.trial190.stdout:/boot/efi/EFI/centos 2026-02-26T02:50:21.415 DEBUG:teuthology.orchestra.run.trial190:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-26T02:50:21.460 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:50:21.480 INFO:teuthology.orchestra.run.trial190.stdout:no 2026-02-26T02:50:21.480 DEBUG:teuthology.orchestra.run.trial190:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-26T02:50:21.544 INFO:teuthology.orchestra.run.trial190.stdout:yes 2026-02-26T02:50:21.544 DEBUG:teuthology.orchestra.run.trial190:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-26T02:50:21.608 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial190 2026-02-26T02:50:21.608 DEBUG:teuthology.orchestra.run.trial190:> sudo bash -c ' 2026-02-26T02:50:21.608 DEBUG:teuthology.orchestra.run.trial190:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-26T02:50:21.608 DEBUG:teuthology.orchestra.run.trial190:> ' 2026-02-26T02:50:21.750 INFO:teuthology.orchestra.run.trial191.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:50:21.772 INFO:teuthology.orchestra.run.trial191.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:50:24.322 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:50:24.356 INFO:teuthology.orchestra.run.trial191.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:50:27.457 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:50:27.464 INFO:teuthology.orchestra.run.trial191.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:30.700 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:48.160 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:48.182 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:48.371 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:48.371 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:50:48.371 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:50:48.371 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-26T02:50:48.428 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:50:48.429 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:50:48.488 DEBUG:teuthology.orchestra.run.trial191:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:50:48.517 INFO:teuthology.orchestra.run.trial191.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:50:48.518 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:50:48.518 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-26T02:50:48.518 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-26T02:50:48.518 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-26T02:50:48.518 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-26T02:50:48.518 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial191.front.sepia.ceph.com, path=None, version=distro) 2026-02-26T02:50:48.518 DEBUG:teuthology.orchestra.run.trial191:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:50:48.582 INFO:teuthology.orchestra.run.trial191.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:50:48.583 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:50:48.583 DEBUG:teuthology.orchestra.run.trial191:> sudo rpm -qi grub2-tools 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Name : grub2-tools 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Epoch : 1 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Version : 2.06 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Release : 120.el9 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Architecture: x86_64 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Group : Unspecified 2026-02-26T02:50:48.654 INFO:teuthology.orchestra.run.trial191.stdout:Size : 9108611 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:License : GPLv3+ 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Packager : builder@centos.org 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Vendor : CentOS 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Summary : Support tools for GRUB. 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:Description : 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:50:48.655 INFO:teuthology.orchestra.run.trial191.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-26T02:50:48.656 INFO:teuthology.orchestra.run.trial191.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-26T02:50:48.656 INFO:teuthology.orchestra.run.trial191.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-26T02:50:48.656 INFO:teuthology.orchestra.run.trial191.stdout:hardware devices. 2026-02-26T02:50:48.656 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:50:48.656 INFO:teuthology.orchestra.run.trial191.stdout:This subpackage provides tools for support of all platforms. 2026-02-26T02:50:48.657 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-26T02:50:48.657 INFO:teuthology.task.kernel:Updating grub on trial191 to boot 5.14.0-686.el9.x86_64 2026-02-26T02:50:48.657 DEBUG:teuthology.orchestra.run.trial191:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-26T02:50:48.725 INFO:teuthology.orchestra.run.trial191.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-26T02:50:48.726 DEBUG:teuthology.orchestra.run.trial191:> sudo command -v grubby && echo yes || echo no 2026-02-26T02:50:48.789 INFO:teuthology.orchestra.run.trial191.stdout:/sbin/grubby 2026-02-26T02:50:48.789 INFO:teuthology.orchestra.run.trial191.stdout:yes 2026-02-26T02:50:48.790 DEBUG:teuthology.orchestra.run.trial191:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-26T02:50:48.854 INFO:teuthology.orchestra.run.trial191.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-26T02:50:48.855 DEBUG:teuthology.orchestra.run.trial191:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-26T02:50:48.926 DEBUG:teuthology.orchestra.run.trial191:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-26T02:50:49.136 INFO:teuthology.orchestra.run.trial191.stderr:Generating grub configuration file ... 2026-02-26T02:50:49.203 INFO:teuthology.orchestra.run.trial191.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-26T02:50:49.210 INFO:teuthology.orchestra.run.trial191.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-26T02:50:49.460 INFO:teuthology.orchestra.run.trial191.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-26T02:50:49.467 INFO:teuthology.orchestra.run.trial191.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-26T02:50:49.501 INFO:teuthology.orchestra.run.trial191.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-26T02:50:49.507 INFO:teuthology.orchestra.run.trial191.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-26T02:50:49.538 INFO:teuthology.orchestra.run.trial191.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-26T02:50:49.545 INFO:teuthology.orchestra.run.trial191.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-26T02:50:49.568 INFO:teuthology.orchestra.run.trial191.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-26T02:50:49.574 INFO:teuthology.orchestra.run.trial191.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-26T02:50:49.661 INFO:teuthology.orchestra.run.trial191.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-26T02:50:49.670 INFO:teuthology.orchestra.run.trial191.stderr:done 2026-02-26T02:50:49.673 DEBUG:teuthology.orchestra.run.trial191:> test -d /sys/firmware/efi 2026-02-26T02:50:49.689 DEBUG:teuthology.orchestra.run.trial191:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-26T02:50:49.754 INFO:teuthology.orchestra.run.trial191.stdout:/boot/efi/EFI/BOOT 2026-02-26T02:50:49.754 INFO:teuthology.orchestra.run.trial191.stdout:/boot/efi/EFI/centos 2026-02-26T02:50:49.756 DEBUG:teuthology.orchestra.run.trial191:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-26T02:50:49.820 INFO:teuthology.orchestra.run.trial191.stdout:no 2026-02-26T02:50:49.821 DEBUG:teuthology.orchestra.run.trial191:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-26T02:50:49.885 INFO:teuthology.orchestra.run.trial191.stdout:yes 2026-02-26T02:50:49.886 DEBUG:teuthology.orchestra.run.trial191:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-26T02:50:49.949 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial191 2026-02-26T02:50:49.949 DEBUG:teuthology.orchestra.run.trial191:> sudo bash -c ' 2026-02-26T02:50:49.949 DEBUG:teuthology.orchestra.run.trial191:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-26T02:50:49.949 DEBUG:teuthology.orchestra.run.trial191:> ' 2026-02-26T02:50:51.651 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-26T02:50:51.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial190.front.sepia.ceph.com' 2026-02-26T02:50:51.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:51:19.992 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-26T02:51:19.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-26T02:51:19.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:51:51.687 DEBUG:teuthology.orchestra.remote:timed out 2026-02-26T02:52:00.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial190.front.sepia.ceph.com' 2026-02-26T02:52:00.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:52:00.833 DEBUG:teuthology.orchestra.run.trial190:> true 2026-02-26T02:52:00.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial190.front.sepia.ceph.com' 2026-02-26T02:52:00.973 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-686.el9.x86_64"... 2026-02-26T02:52:00.973 DEBUG:teuthology.orchestra.run.trial190:> uname -r 2026-02-26T02:52:01.029 INFO:teuthology.orchestra.run.trial190.stdout:5.14.0-686.el9.x86_64 2026-02-26T02:52:01.029 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-26T02:52:01.029 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-26T02:52:01.029 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-26T02:52:02.030 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-26T02:52:02.030 DEBUG:teuthology.orchestra.run.trial190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-26T02:52:02.061 INFO:teuthology.orchestra.run.trial190.stdout:ttyS1 2026-02-26T02:52:02.077 DEBUG:teuthology.parallel:result is None 2026-02-26T02:52:19.995 DEBUG:teuthology.orchestra.remote:timed out 2026-02-26T02:52:28.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-26T02:52:28.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:52:29.086 DEBUG:teuthology.orchestra.run.trial191:> true 2026-02-26T02:52:29.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-26T02:52:29.243 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-686.el9.x86_64"... 2026-02-26T02:52:29.243 DEBUG:teuthology.orchestra.run.trial191:> uname -r 2026-02-26T02:52:29.300 INFO:teuthology.orchestra.run.trial191.stdout:5.14.0-686.el9.x86_64 2026-02-26T02:52:29.300 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-26T02:52:29.301 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-26T02:52:29.301 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-26T02:52:30.302 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-26T02:52:30.302 DEBUG:teuthology.orchestra.run.trial191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-26T02:52:30.333 INFO:teuthology.orchestra.run.trial191.stdout:ttyS1 2026-02-26T02:52:30.354 DEBUG:teuthology.parallel:result is None 2026-02-26T02:52:30.354 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-26T02:52:30.366 INFO:teuthology.task.internal:Creating test directory... 2026-02-26T02:52:30.366 DEBUG:teuthology.orchestra.run.trial190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-26T02:52:30.369 DEBUG:teuthology.orchestra.run.trial191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-26T02:52:30.410 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-26T02:52:30.422 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-26T02:52:30.436 INFO:teuthology.task.internal:Creating archive directory... 2026-02-26T02:52:30.436 DEBUG:teuthology.orchestra.run.trial190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-26T02:52:30.439 DEBUG:teuthology.orchestra.run.trial191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-26T02:52:30.473 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-26T02:52:30.485 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-26T02:52:30.485 DEBUG:teuthology.orchestra.run.trial190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-26T02:52:30.495 DEBUG:teuthology.orchestra.run.trial191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-26T02:52:30.517 INFO:teuthology.orchestra.run.trial190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:52:30.526 INFO:teuthology.orchestra.run.trial190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:52:30.530 INFO:teuthology.orchestra.run.trial191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:52:30.539 INFO:teuthology.orchestra.run.trial191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:52:30.540 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-26T02:52:30.551 INFO:teuthology.task.internal:Configuring sudo... 2026-02-26T02:52:30.551 DEBUG:teuthology.orchestra.run.trial190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-26T02:52:30.569 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-26T02:52:30.603 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-26T02:52:30.616 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-26T02:52:30.616 DEBUG:teuthology.orchestra.run.trial190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-26T02:52:30.633 DEBUG:teuthology.orchestra.run.trial191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-26T02:52:30.659 DEBUG:teuthology.orchestra.run.trial190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:52:30.802 DEBUG:teuthology.orchestra.run.trial190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:52:30.828 DEBUG:teuthology.orchestra.run.trial190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:52:30.946 DEBUG:teuthology.orchestra.run.trial190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:52:30.968 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:52:30.968 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-26T02:52:31.032 DEBUG:teuthology.orchestra.run.trial191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:52:31.122 DEBUG:teuthology.orchestra.run.trial191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:52:31.146 DEBUG:teuthology.orchestra.run.trial191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:52:31.262 DEBUG:teuthology.orchestra.run.trial191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:52:31.284 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:52:31.285 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-26T02:52:31.348 DEBUG:teuthology.orchestra.run.trial190:> sudo service rsyslog restart 2026-02-26T02:52:31.350 DEBUG:teuthology.orchestra.run.trial191:> sudo service rsyslog restart 2026-02-26T02:52:31.377 INFO:teuthology.orchestra.run.trial190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:52:31.416 INFO:teuthology.orchestra.run.trial191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:52:31.936 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-26T02:52:31.949 INFO:teuthology.task.internal:Starting timer... 2026-02-26T02:52:31.949 INFO:teuthology.run_tasks:Running task pcp... 2026-02-26T02:52:31.967 INFO:teuthology.run_tasks:Running task selinux... 2026-02-26T02:52:31.983 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2026-02-26T02:52:31.984 DEBUG:teuthology.orchestra.run.trial190:> sudo service auditd rotate 2026-02-26T02:52:32.014 INFO:teuthology.orchestra.run.trial190.stdout:Rotating logs: 2026-02-26T02:52:32.015 DEBUG:teuthology.orchestra.run.trial191:> sudo service auditd rotate 2026-02-26T02:52:32.045 INFO:teuthology.orchestra.run.trial191.stdout:Rotating logs: 2026-02-26T02:52:32.047 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-26T02:52:32.047 DEBUG:teuthology.orchestra.run.trial190:> /usr/sbin/getenforce 2026-02-26T02:52:32.071 INFO:teuthology.orchestra.run.trial190.stdout:Permissive 2026-02-26T02:52:32.072 DEBUG:teuthology.orchestra.run.trial191:> /usr/sbin/getenforce 2026-02-26T02:52:32.104 INFO:teuthology.orchestra.run.trial191.stdout:Permissive 2026-02-26T02:52:32.104 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial190.front.sepia.ceph.com': 'permissive', 'ubuntu@trial191.front.sepia.ceph.com': 'permissive'} 2026-02-26T02:52:32.104 DEBUG:teuthology.orchestra.run.trial190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-26T02:52:32.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:52:32.137 DEBUG:teuthology.orchestra.run.trial191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-26T02:52:32.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:52:32.169 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-26T02:52:32.169 DEBUG:teuthology.orchestra.run.trial190:> sudo /usr/sbin/setenforce permissive 2026-02-26T02:52:32.200 DEBUG:teuthology.orchestra.run.trial191:> sudo /usr/sbin/setenforce permissive 2026-02-26T02:52:32.231 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-26T02:52:32.244 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-26T02:52:32.246 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-26T02:52:32.343 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-26T02:52:32.350 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-26T02:52:32.350 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial190.front.sepia.ceph.com,trial191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-26T02:55:25.806 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial190.front.sepia.ceph.com'), Remote(name='ubuntu@trial191.front.sepia.ceph.com')] 2026-02-26T02:55:25.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial190.front.sepia.ceph.com' 2026-02-26T02:55:25.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:55:25.921 DEBUG:teuthology.orchestra.run.trial190:> true 2026-02-26T02:55:26.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial190.front.sepia.ceph.com' 2026-02-26T02:55:26.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-26T02:55:26.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:55:26.099 DEBUG:teuthology.orchestra.run.trial191:> true 2026-02-26T02:55:26.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-26T02:55:26.174 INFO:teuthology.run_tasks:Running task clock... 2026-02-26T02:55:26.185 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-26T02:55:26.185 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-26T02:55:26.186 DEBUG:teuthology.orchestra.run.trial190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:55:26.188 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-26T02:55:26.188 DEBUG:teuthology.orchestra.run.trial191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:55:26.214 INFO:teuthology.orchestra.run.trial190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-26T02:55:26.226 INFO:teuthology.orchestra.run.trial190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-26T02:55:26.241 INFO:teuthology.orchestra.run.trial191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-26T02:55:26.246 INFO:teuthology.orchestra.run.trial190.stderr:sudo: ntpd: command not found 2026-02-26T02:55:26.253 INFO:teuthology.orchestra.run.trial191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-26T02:55:26.255 INFO:teuthology.orchestra.run.trial190.stdout:506 Cannot talk to daemon 2026-02-26T02:55:26.267 INFO:teuthology.orchestra.run.trial190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-26T02:55:26.273 INFO:teuthology.orchestra.run.trial191.stderr:sudo: ntpd: command not found 2026-02-26T02:55:26.278 INFO:teuthology.orchestra.run.trial190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-26T02:55:26.283 INFO:teuthology.orchestra.run.trial191.stdout:506 Cannot talk to daemon 2026-02-26T02:55:26.295 INFO:teuthology.orchestra.run.trial191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-26T02:55:26.306 INFO:teuthology.orchestra.run.trial191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-26T02:55:26.321 INFO:teuthology.orchestra.run.trial190.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:55:26.324 INFO:teuthology.orchestra.run.trial190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:55:26.324 INFO:teuthology.orchestra.run.trial190.stdout:=============================================================================== 2026-02-26T02:55:26.353 INFO:teuthology.orchestra.run.trial191.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:55:26.354 INFO:teuthology.orchestra.run.trial191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:55:26.355 INFO:teuthology.orchestra.run.trial191.stdout:=============================================================================== 2026-02-26T02:55:26.356 INFO:teuthology.run_tasks:Running task pexec... 2026-02-26T02:55:26.372 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-26T02:55:26.372 DEBUG:teuthology.orchestra.run.trial190:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-26T02:55:26.373 DEBUG:teuthology.orchestra.run.trial191:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-26T02:55:26.375 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial190.front.sepia.ceph.com 2026-02-26T02:55:26.375 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-26T02:55:26.375 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-02-26T02:55:26.375 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-02-26T02:55:26.375 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-02-26T02:55:26.398 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial191.front.sepia.ceph.com 2026-02-26T02:55:26.398 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-26T02:55:26.398 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-02-26T02:55:26.398 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-02-26T02:55:26.398 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-02-26T02:55:26.554 INFO:teuthology.orchestra.run.trial190.stdout:No match for argument: nvme-cli 2026-02-26T02:55:26.554 INFO:teuthology.orchestra.run.trial190.stderr:No packages marked for removal. 2026-02-26T02:55:26.556 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:55:26.557 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:55:26.557 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:55:26.574 INFO:teuthology.orchestra.run.trial191.stdout:No match for argument: nvme-cli 2026-02-26T02:55:26.574 INFO:teuthology.orchestra.run.trial191.stderr:No packages marked for removal. 2026-02-26T02:55:26.576 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:55:26.577 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:55:26.577 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:55:26.867 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:41 ago on Thu 26 Feb 2026 02:54:45 AM UTC. 2026-02-26T02:55:26.889 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:41 ago on Thu 26 Feb 2026 02:54:45 AM UTC. 2026-02-26T02:55:26.950 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:55:26.951 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:55:26.952 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repository Size 2026-02-26T02:55:26.952 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:55:26.952 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:55:26.952 INFO:teuthology.orchestra.run.trial190.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-26T02:55:26.952 INFO:teuthology.orchestra.run.trial190.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-26T02:55:26.952 INFO:teuthology.orchestra.run.trial190.stdout: runc x86_64 4:1.4.0-1.el9 appstream 4.0 M 2026-02-26T02:55:26.952 INFO:teuthology.orchestra.run.trial190.stdout:Installing dependencies: 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:55:26.953 INFO:teuthology.orchestra.run.trial190.stdout:Install 7 Packages 2026-02-26T02:55:26.954 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:55:26.954 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 6.3 M 2026-02-26T02:55:26.954 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 24 M 2026-02-26T02:55:26.954 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:55:26.972 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:55:26.973 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:55:26.973 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repository Size 2026-02-26T02:55:26.973 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:55:26.973 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:55:26.973 INFO:teuthology.orchestra.run.trial191.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-26T02:55:26.973 INFO:teuthology.orchestra.run.trial191.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout: runc x86_64 4:1.4.0-1.el9 appstream 4.0 M 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout:Installing dependencies: 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout:Install 7 Packages 2026-02-26T02:55:26.974 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:55:26.975 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 6.3 M 2026-02-26T02:55:26.975 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 24 M 2026-02-26T02:55:26.975 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:55:27.200 INFO:teuthology.orchestra.run.trial191.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 435 kB/s | 44 kB 00:00 2026-02-26T02:55:27.216 INFO:teuthology.orchestra.run.trial191.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 614 kB/s | 72 kB 00:00 2026-02-26T02:55:27.255 INFO:teuthology.orchestra.run.trial191.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.5 MB/s | 84 kB 00:00 2026-02-26T02:55:27.282 INFO:teuthology.orchestra.run.trial191.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.2 MB/s | 150 kB 00:00 2026-02-26T02:55:27.315 INFO:teuthology.orchestra.run.trial191.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2026-02-26T02:55:27.358 INFO:teuthology.orchestra.run.trial191.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 8.0 MB/s | 837 kB 00:00 2026-02-26T02:55:27.565 INFO:teuthology.orchestra.run.trial190.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 435 kB/s | 44 kB 00:00 2026-02-26T02:55:27.579 INFO:teuthology.orchestra.run.trial190.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 624 kB/s | 72 kB 00:00 2026-02-26T02:55:27.621 INFO:teuthology.orchestra.run.trial190.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.5 MB/s | 84 kB 00:00 2026-02-26T02:55:27.652 INFO:teuthology.orchestra.run.trial190.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.0 MB/s | 150 kB 00:00 2026-02-26T02:55:27.678 INFO:teuthology.orchestra.run.trial190.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2026-02-26T02:55:27.722 INFO:teuthology.orchestra.run.trial190.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 8.0 MB/s | 837 kB 00:00 2026-02-26T02:55:28.407 INFO:teuthology.orchestra.run.trial191.stdout:(7/7): runc-1.4.0-1.el9.x86_64.rpm 3.5 MB/s | 4.0 MB 00:01 2026-02-26T02:55:28.408 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:55:28.409 INFO:teuthology.orchestra.run.trial191.stdout:Total 4.4 MB/s | 6.3 MB 00:01 2026-02-26T02:55:28.474 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:55:28.481 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:55:28.481 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:55:28.558 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:55:28.558 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:55:28.702 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:55:28.709 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2026-02-26T02:55:28.718 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/7 2026-02-26T02:55:28.724 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-26T02:55:28.730 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-26T02:55:28.731 INFO:teuthology.orchestra.run.trial191.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-02-26T02:55:28.777 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-02-26T02:55:28.803 INFO:teuthology.orchestra.run.trial190.stdout:(7/7): runc-1.4.0-1.el9.x86_64.rpm 3.4 MB/s | 4.0 MB 00:01 2026-02-26T02:55:28.803 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:55:28.803 INFO:teuthology.orchestra.run.trial190.stdout:Total 3.4 MB/s | 6.3 MB 00:01 2026-02-26T02:55:28.869 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:55:28.876 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:55:28.876 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:55:28.889 INFO:teuthology.orchestra.run.trial191.stdout: Installing : runc-4:1.4.0-1.el9.x86_64 6/7 2026-02-26T02:55:28.891 INFO:teuthology.orchestra.run.trial191.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/7 2026-02-26T02:55:28.955 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:55:28.955 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:55:29.101 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:55:29.109 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2026-02-26T02:55:29.118 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/7 2026-02-26T02:55:29.123 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-26T02:55:29.129 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-26T02:55:29.129 INFO:teuthology.orchestra.run.trial190.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-02-26T02:55:29.176 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/7 2026-02-26T02:55:29.176 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-26T02:55:29.176 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:55:29.177 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-02-26T02:55:29.289 INFO:teuthology.orchestra.run.trial190.stdout: Installing : runc-4:1.4.0-1.el9.x86_64 6/7 2026-02-26T02:55:29.291 INFO:teuthology.orchestra.run.trial190.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/7 2026-02-26T02:55:29.433 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-02-26T02:55:29.433 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-02-26T02:55:29.433 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-26T02:55:29.433 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-26T02:55:29.433 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/7 2026-02-26T02:55:29.433 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : runc-4:1.4.0-1.el9.x86_64 7/7 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout: runc-4:1.4.0-1.el9.x86_64 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:55:29.492 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:55:29.547 DEBUG:teuthology.parallel:result is None 2026-02-26T02:55:29.569 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/7 2026-02-26T02:55:29.569 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-26T02:55:29.569 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:55:29.824 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-02-26T02:55:29.824 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-02-26T02:55:29.824 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-26T02:55:29.824 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-26T02:55:29.824 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/7 2026-02-26T02:55:29.825 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : runc-4:1.4.0-1.el9.x86_64 7/7 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout: runc-4:1.4.0-1.el9.x86_64 2026-02-26T02:55:29.884 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:55:29.885 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:55:29.936 DEBUG:teuthology.parallel:result is None 2026-02-26T02:55:29.936 INFO:teuthology.run_tasks:Running task install... 2026-02-26T02:55:29.950 DEBUG:teuthology.task.install:project ceph 2026-02-26T02:55:29.950 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5'}} 2026-02-26T02:55:29.950 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5'} 2026-02-26T02:55:29.950 INFO:teuthology.task.install:Using flavor: default 2026-02-26T02:55:29.959 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-26T02:55:29.959 INFO:teuthology.task.install:extra packages: [] 2026-02-26T02:55:29.960 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'tag': None, 'wait_for_package': False} 2026-02-26T02:55:29.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:55:29.963 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'tag': None, 'wait_for_package': False} 2026-02-26T02:55:29.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:55:30.157 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/ 2026-02-26T02:55:30.157 INFO:teuthology.task.install.rpm:Package version is 19.2.3-687.g8d724284 2026-02-26T02:55:30.171 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/ 2026-02-26T02:55:30.172 INFO:teuthology.task.install.rpm:Package version is 19.2.3-687.g8d724284 2026-02-26T02:55:30.505 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T02:55:30.505 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:55:30.506 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T02:55:30.533 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-26T02:55:30.533 DEBUG:teuthology.orchestra.run.trial190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T02:55:30.555 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T02:55:30.555 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:55:30.556 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T02:55:30.584 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-26T02:55:30.584 DEBUG:teuthology.orchestra.run.trial191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T02:55:30.598 DEBUG:teuthology.orchestra.run.trial190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T02:55:30.650 DEBUG:teuthology.orchestra.run.trial191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T02:55:30.672 DEBUG:teuthology.orchestra.run.trial190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T02:55:30.724 DEBUG:teuthology.orchestra.run.trial191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T02:55:30.736 INFO:teuthology.orchestra.run.trial190.stdout:check_obsoletes = 1 2026-02-26T02:55:30.738 DEBUG:teuthology.orchestra.run.trial190:> sudo yum clean all 2026-02-26T02:55:30.787 INFO:teuthology.orchestra.run.trial191.stdout:check_obsoletes = 1 2026-02-26T02:55:30.789 DEBUG:teuthology.orchestra.run.trial191:> sudo yum clean all 2026-02-26T02:55:30.885 INFO:teuthology.orchestra.run.trial190.stdout:41 files removed 2026-02-26T02:55:30.899 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-radosgw 2026-02-26T02:55:30.936 INFO:teuthology.orchestra.run.trial191.stdout:41 files removed 2026-02-26T02:55:30.950 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-radosgw 2026-02-26T02:55:31.572 INFO:teuthology.orchestra.run.trial190.stdout:ceph packages for x86_64 163 kB/s | 86 kB 00:00 2026-02-26T02:55:31.582 INFO:teuthology.orchestra.run.trial191.stdout:ceph packages for x86_64 177 kB/s | 86 kB 00:00 2026-02-26T02:55:31.761 INFO:teuthology.orchestra.run.trial190.stdout:ceph noarch packages 74 kB/s | 12 kB 00:00 2026-02-26T02:55:31.768 INFO:teuthology.orchestra.run.trial191.stdout:ceph noarch packages 75 kB/s | 12 kB 00:00 2026-02-26T02:55:31.968 INFO:teuthology.orchestra.run.trial190.stdout:ceph source packages 10 kB/s | 1.9 kB 00:00 2026-02-26T02:55:31.988 INFO:teuthology.orchestra.run.trial191.stdout:ceph source packages 9.6 kB/s | 1.9 kB 00:00 2026-02-26T02:55:32.664 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-26T02:55:33.369 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-26T02:55:36.003 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-26T02:55:36.614 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 27 MB 00:03 2026-02-26T02:55:39.922 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 8.0 MB 00:01 2026-02-26T02:55:41.288 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 8.0 MB 00:02 2026-02-26T02:55:57.039 INFO:teuthology.orchestra.run.trial191.stdout:CentOS Stream 9 - Extras packages 1.2 kB/s | 20 kB 00:16 2026-02-26T02:55:57.123 INFO:teuthology.orchestra.run.trial190.stdout:CentOS Stream 9 - Extras packages 1.3 kB/s | 20 kB 00:15 2026-02-26T02:55:57.763 INFO:teuthology.orchestra.run.trial190.stdout:Extra Packages for Enterprise Linux 35 MB/s | 20 MB 00:00 2026-02-26T02:55:58.204 INFO:teuthology.orchestra.run.trial191.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-26T02:56:00.939 INFO:teuthology.orchestra.run.trial190.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-26T02:56:01.436 INFO:teuthology.orchestra.run.trial191.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-26T02:56:02.178 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repository Size 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout: ceph-radosgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout:Upgrading: 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout: librados2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.4 M 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout: librbd1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.2 M 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout:Installing dependencies: 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-26T02:56:02.179 INFO:teuthology.orchestra.run.trial190.stdout: ceph-base x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.5 M 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 22 M 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: ceph-selinux x86_64 2:19.2.3-687.g8d724284.el9 ceph 25 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: libcephfs2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 999 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: libradosstriper1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 504 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: librgw2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.4 M 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: python3-ceph-argparse x86_64 2:19.2.3-687.g8d724284.el9 ceph 45 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: python3-ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 142 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: python3-cephfs x86_64 2:19.2.3-687.g8d724284.el9 ceph 165 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: python3-rados x86_64 2:19.2.3-687.g8d724284.el9 ceph 321 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: python3-rbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 303 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: python3-rgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 100 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout:Installing weak dependencies: 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout:Install 32 Packages 2026-02-26T02:56:02.180 INFO:teuthology.orchestra.run.trial190.stdout:Upgrade 2 Packages 2026-02-26T02:56:02.181 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:02.181 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 62 M 2026-02-26T02:56:02.181 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:02.670 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repository Size 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: ceph-radosgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout:Upgrading: 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: librados2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.4 M 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: librbd1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.2 M 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout:Installing dependencies: 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: ceph-base x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.5 M 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 22 M 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: ceph-selinux x86_64 2:19.2.3-687.g8d724284.el9 ceph 25 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: libcephfs2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 999 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: libradosstriper1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 504 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: librgw2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.4 M 2026-02-26T02:56:02.671 INFO:teuthology.orchestra.run.trial191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: python3-ceph-argparse x86_64 2:19.2.3-687.g8d724284.el9 ceph 45 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: python3-ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 142 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: python3-cephfs x86_64 2:19.2.3-687.g8d724284.el9 ceph 165 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: python3-rados x86_64 2:19.2.3-687.g8d724284.el9 ceph 321 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: python3-rbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 303 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: python3-rgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 100 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-26T02:56:02.672 INFO:teuthology.orchestra.run.trial191.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout:Installing weak dependencies: 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout:Install 32 Packages 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout:Upgrade 2 Packages 2026-02-26T02:56:02.673 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:02.674 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 62 M 2026-02-26T02:56:02.674 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:56:03.260 INFO:teuthology.orchestra.run.trial190.stdout:(1/34): ceph-base-19.2.3-687.g8d724284.el9.x86_ 8.6 MB/s | 5.5 MB 00:00 2026-02-26T02:56:03.316 INFO:teuthology.orchestra.run.trial190.stdout:(2/34): ceph-selinux-19.2.3-687.g8d724284.el9.x 451 kB/s | 25 kB 00:00 2026-02-26T02:56:03.358 INFO:teuthology.orchestra.run.trial190.stdout:(3/34): ceph-radosgw-19.2.3-687.g8d724284.el9.x 15 MB/s | 11 MB 00:00 2026-02-26T02:56:03.417 INFO:teuthology.orchestra.run.trial190.stdout:(4/34): libradosstriper1-19.2.3-687.g8d724284.e 8.4 MB/s | 504 kB 00:00 2026-02-26T02:56:03.424 INFO:teuthology.orchestra.run.trial190.stdout:(5/34): libcephfs2-19.2.3-687.g8d724284.el9.x86 9.1 MB/s | 999 kB 00:00 2026-02-26T02:56:03.487 INFO:teuthology.orchestra.run.trial190.stdout:(6/34): python3-ceph-argparse-19.2.3-687.g8d724 718 kB/s | 45 kB 00:00 2026-02-26T02:56:03.710 INFO:teuthology.orchestra.run.trial190.stdout:(7/34): librgw2-19.2.3-687.g8d724284.el9.x86_64 18 MB/s | 5.4 MB 00:00 2026-02-26T02:56:03.747 INFO:teuthology.orchestra.run.trial190.stdout:(8/34): python3-cephfs-19.2.3-687.g8d724284.el9 4.4 MB/s | 165 kB 00:00 2026-02-26T02:56:03.789 INFO:teuthology.orchestra.run.trial190.stdout:(9/34): python3-rados-19.2.3-687.g8d724284.el9. 7.7 MB/s | 321 kB 00:00 2026-02-26T02:56:03.819 INFO:teuthology.orchestra.run.trial190.stdout:(10/34): ceph-common-19.2.3-687.g8d724284.el9.x 18 MB/s | 22 MB 00:01 2026-02-26T02:56:03.820 INFO:teuthology.orchestra.run.trial190.stdout:(11/34): python3-rbd-19.2.3-687.g8d724284.el9.x 9.5 MB/s | 303 kB 00:00 2026-02-26T02:56:03.837 INFO:teuthology.orchestra.run.trial190.stdout:(12/34): python3-rgw-19.2.3-687.g8d724284.el9.x 5.3 MB/s | 100 kB 00:00 2026-02-26T02:56:03.838 INFO:teuthology.orchestra.run.trial190.stdout:(13/34): python3-ceph-common-19.2.3-687.g8d7242 405 kB/s | 142 kB 00:00 2026-02-26T02:56:03.946 INFO:teuthology.orchestra.run.trial190.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 965 kB/s | 104 kB 00:00 2026-02-26T02:56:04.066 INFO:teuthology.orchestra.run.trial190.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 1.3 MB/s | 164 kB 00:00 2026-02-26T02:56:04.092 INFO:teuthology.orchestra.run.trial190.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.2 MB/s | 160 kB 00:00 2026-02-26T02:56:04.114 INFO:teuthology.orchestra.run.trial190.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-26T02:56:04.161 INFO:teuthology.orchestra.run.trial190.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-26T02:56:04.187 INFO:teuthology.orchestra.run.trial190.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 11 MB/s | 292 kB 00:00 2026-02-26T02:56:04.212 INFO:teuthology.orchestra.run.trial190.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 9.5 MB/s | 240 kB 00:00 2026-02-26T02:56:04.228 INFO:teuthology.orchestra.run.trial190.stdout:(21/34): mailcap-2.1.49-5.el9.noarch.rpm 81 kB/s | 33 kB 00:00 2026-02-26T02:56:04.234 INFO:teuthology.orchestra.run.trial190.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.6 MB/s | 37 kB 00:00 2026-02-26T02:56:04.296 INFO:teuthology.orchestra.run.trial191.stdout:(1/34): ceph-base-19.2.3-687.g8d724284.el9.x86_ 8.5 MB/s | 5.5 MB 00:00 2026-02-26T02:56:04.314 INFO:teuthology.orchestra.run.trial190.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 769 kB/s | 66 kB 00:00 2026-02-26T02:56:04.331 INFO:teuthology.orchestra.run.trial191.stdout:(2/34): ceph-selinux-19.2.3-687.g8d724284.el9.x 699 kB/s | 25 kB 00:00 2026-02-26T02:56:04.423 INFO:teuthology.orchestra.run.trial191.stdout:(3/34): libcephfs2-19.2.3-687.g8d724284.el9.x86 11 MB/s | 999 kB 00:00 2026-02-26T02:56:04.472 INFO:teuthology.orchestra.run.trial191.stdout:(4/34): libradosstriper1-19.2.3-687.g8d724284.e 10 MB/s | 504 kB 00:00 2026-02-26T02:56:04.475 INFO:teuthology.orchestra.run.trial190.stdout:(24/34): pciutils-3.7.0-7.el9.x86_64.rpm 146 kB/s | 93 kB 00:00 2026-02-26T02:56:04.692 INFO:teuthology.orchestra.run.trial190.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 114 kB/s | 25 kB 00:00 2026-02-26T02:56:04.693 INFO:teuthology.orchestra.run.trial190.stdout:(26/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 670 kB/s | 308 kB 00:00 2026-02-26T02:56:04.769 INFO:teuthology.orchestra.run.trial190.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 886 kB/s | 67 kB 00:00 2026-02-26T02:56:04.840 INFO:teuthology.orchestra.run.trial190.stdout:(28/34): liboath-2.6.12-1.el9.x86_64.rpm 332 kB/s | 49 kB 00:00 2026-02-26T02:56:04.851 INFO:teuthology.orchestra.run.trial191.stdout:(5/34): ceph-radosgw-19.2.3-687.g8d724284.el9.x 8.9 MB/s | 11 MB 00:01 2026-02-26T02:56:04.908 INFO:teuthology.orchestra.run.trial191.stdout:(6/34): python3-ceph-argparse-19.2.3-687.g8d724 792 kB/s | 45 kB 00:00 2026-02-26T02:56:04.937 INFO:teuthology.orchestra.run.trial191.stdout:(7/34): librgw2-19.2.3-687.g8d724284.el9.x86_64 12 MB/s | 5.4 MB 00:00 2026-02-26T02:56:04.957 INFO:teuthology.orchestra.run.trial191.stdout:(8/34): python3-ceph-common-19.2.3-687.g8d72428 2.8 MB/s | 142 kB 00:00 2026-02-26T02:56:04.966 INFO:teuthology.orchestra.run.trial190.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.2 MB/s | 838 kB 00:00 2026-02-26T02:56:04.981 INFO:teuthology.orchestra.run.trial191.stdout:(9/34): python3-cephfs-19.2.3-687.g8d724284.el9 3.6 MB/s | 165 kB 00:00 2026-02-26T02:56:05.012 INFO:teuthology.orchestra.run.trial191.stdout:(10/34): python3-rados-19.2.3-687.g8d724284.el9 5.7 MB/s | 321 kB 00:00 2026-02-26T02:56:05.025 INFO:teuthology.orchestra.run.trial190.stdout:(30/34): libarrow-9.0.0-15.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2026-02-26T02:56:05.037 INFO:teuthology.orchestra.run.trial190.stdout:(31/34): re2-20211101-20.el9.x86_64.rpm 970 kB/s | 191 kB 00:00 2026-02-26T02:56:05.040 INFO:teuthology.orchestra.run.trial191.stdout:(11/34): python3-rbd-19.2.3-687.g8d724284.el9.x 5.1 MB/s | 303 kB 00:00 2026-02-26T02:56:05.068 INFO:teuthology.orchestra.run.trial191.stdout:(12/34): python3-rgw-19.2.3-687.g8d724284.el9.x 1.8 MB/s | 100 kB 00:00 2026-02-26T02:56:05.131 INFO:teuthology.orchestra.run.trial190.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 9.6 MB/s | 1.6 MB 00:00 2026-02-26T02:56:05.451 INFO:teuthology.orchestra.run.trial191.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 81 kB/s | 33 kB 00:00 2026-02-26T02:56:05.492 INFO:teuthology.orchestra.run.trial191.stdout:(14/34): ceph-common-19.2.3-687.g8d724284.el9.x 12 MB/s | 22 MB 00:01 2026-02-26T02:56:05.571 INFO:teuthology.orchestra.run.trial191.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 185 kB/s | 93 kB 00:00 2026-02-26T02:56:05.608 INFO:teuthology.orchestra.run.trial190.stdout:(33/34): librbd1-19.2.3-687.g8d724284.el9.x86_6 5.6 MB/s | 3.2 MB 00:00 2026-02-26T02:56:05.642 INFO:teuthology.orchestra.run.trial190.stdout:(34/34): librados2-19.2.3-687.g8d724284.el9.x86 5.6 MB/s | 3.4 MB 00:00 2026-02-26T02:56:05.645 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:05.645 INFO:teuthology.orchestra.run.trial190.stdout:Total 18 MB/s | 62 MB 00:03 2026-02-26T02:56:05.734 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:05.752 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:05.752 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:05.856 INFO:teuthology.orchestra.run.trial191.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 257 kB/s | 104 kB 00:00 2026-02-26T02:56:05.941 INFO:teuthology.orchestra.run.trial191.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 366 kB/s | 164 kB 00:00 2026-02-26T02:56:05.958 INFO:teuthology.orchestra.run.trial191.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 445 kB/s | 45 kB 00:00 2026-02-26T02:56:05.981 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:05.982 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:06.021 INFO:teuthology.orchestra.run.trial191.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 355 kB/s | 160 kB 00:00 2026-02-26T02:56:06.184 INFO:teuthology.orchestra.run.trial191.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2026-02-26T02:56:06.199 INFO:teuthology.orchestra.run.trial191.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-26T02:56:06.206 INFO:teuthology.orchestra.run.trial191.stdout:(22/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2026-02-26T02:56:06.268 INFO:teuthology.orchestra.run.trial191.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 442 kB/s | 37 kB 00:00 2026-02-26T02:56:06.268 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:06.277 INFO:teuthology.orchestra.run.trial190.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-26T02:56:06.279 INFO:teuthology.orchestra.run.trial190.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-26T02:56:06.287 INFO:teuthology.orchestra.run.trial191.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 758 kB/s | 66 kB 00:00 2026-02-26T02:56:06.291 INFO:teuthology.orchestra.run.trial190.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-26T02:56:06.406 INFO:teuthology.orchestra.run.trial191.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 208 kB/s | 25 kB 00:00 2026-02-26T02:56:06.444 INFO:teuthology.orchestra.run.trial190.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-26T02:56:06.449 INFO:teuthology.orchestra.run.trial190.stdout: Upgrading : librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/36 2026-02-26T02:56:06.467 INFO:teuthology.orchestra.run.trial191.stdout:(26/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-26T02:56:06.477 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/36 2026-02-26T02:56:06.487 INFO:teuthology.orchestra.run.trial191.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 606 kB/s | 49 kB 00:00 2026-02-26T02:56:06.507 INFO:teuthology.orchestra.run.trial191.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-26T02:56:06.520 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 6/36 2026-02-26T02:56:06.521 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/36 2026-02-26T02:56:06.533 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/36 2026-02-26T02:56:06.537 INFO:teuthology.orchestra.run.trial190.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-26T02:56:06.546 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 9/36 2026-02-26T02:56:06.557 INFO:teuthology.orchestra.run.trial191.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2026-02-26T02:56:06.569 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/36 2026-02-26T02:56:06.569 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/36 2026-02-26T02:56:06.582 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/36 2026-02-26T02:56:06.616 INFO:teuthology.orchestra.run.trial190.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-26T02:56:06.619 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-26T02:56:06.625 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-26T02:56:06.628 INFO:teuthology.orchestra.run.trial190.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-26T02:56:06.631 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-26T02:56:06.635 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-26T02:56:06.664 INFO:teuthology.orchestra.run.trial191.stdout:(30/34): libarrow-9.0.0-15.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2026-02-26T02:56:06.667 INFO:teuthology.orchestra.run.trial191.stdout:(31/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2026-02-26T02:56:06.691 INFO:teuthology.orchestra.run.trial191.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-26T02:56:06.777 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-26T02:56:06.778 INFO:teuthology.orchestra.run.trial190.stdout: Upgrading : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/36 2026-02-26T02:56:06.808 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/36 2026-02-26T02:56:06.810 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 20/36 2026-02-26T02:56:06.816 INFO:teuthology.orchestra.run.trial190.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-26T02:56:07.049 INFO:teuthology.orchestra.run.trial190.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-26T02:56:07.050 INFO:teuthology.orchestra.run.trial190.stdout: Installing : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/36 2026-02-26T02:56:07.067 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/36 2026-02-26T02:56:07.070 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 24/36 2026-02-26T02:56:07.075 INFO:teuthology.orchestra.run.trial190.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-26T02:56:07.077 INFO:teuthology.orchestra.run.trial190.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-26T02:56:07.078 INFO:teuthology.orchestra.run.trial190.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-26T02:56:07.096 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-26T02:56:07.098 INFO:teuthology.orchestra.run.trial190.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-26T02:56:07.125 INFO:teuthology.orchestra.run.trial190.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-26T02:56:07.127 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 30/36 2026-02-26T02:56:07.163 INFO:teuthology.orchestra.run.trial191.stdout:(33/34): librbd1-19.2.3-687.g8d724284.el9.x86_6 6.4 MB/s | 3.2 MB 00:00 2026-02-26T02:56:07.364 INFO:teuthology.orchestra.run.trial191.stdout:(34/34): librados2-19.2.3-687.g8d724284.el9.x86 4.9 MB/s | 3.4 MB 00:00 2026-02-26T02:56:07.367 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:07.367 INFO:teuthology.orchestra.run.trial191.stdout:Total 13 MB/s | 62 MB 00:04 2026-02-26T02:56:07.456 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:56:07.474 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:56:07.474 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:56:07.705 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:56:07.705 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:56:07.992 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:56:08.000 INFO:teuthology.orchestra.run.trial191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-26T02:56:08.004 INFO:teuthology.orchestra.run.trial191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-26T02:56:08.016 INFO:teuthology.orchestra.run.trial191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-26T02:56:08.127 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 31/36 2026-02-26T02:56:08.130 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 31/36 2026-02-26T02:56:08.166 INFO:teuthology.orchestra.run.trial191.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-26T02:56:08.170 INFO:teuthology.orchestra.run.trial191.stdout: Upgrading : librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/36 2026-02-26T02:56:08.201 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/36 2026-02-26T02:56:08.243 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 6/36 2026-02-26T02:56:08.244 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/36 2026-02-26T02:56:08.255 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/36 2026-02-26T02:56:08.260 INFO:teuthology.orchestra.run.trial191.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-26T02:56:08.269 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 9/36 2026-02-26T02:56:08.291 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/36 2026-02-26T02:56:08.292 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/36 2026-02-26T02:56:08.305 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/36 2026-02-26T02:56:08.336 INFO:teuthology.orchestra.run.trial191.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-26T02:56:08.340 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-26T02:56:08.346 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-26T02:56:08.348 INFO:teuthology.orchestra.run.trial191.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-26T02:56:08.351 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-26T02:56:08.356 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-26T02:56:08.414 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 31/36 2026-02-26T02:56:08.417 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 32/36 2026-02-26T02:56:08.456 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 32/36 2026-02-26T02:56:08.456 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-26T02:56:08.456 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-26T02:56:08.456 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:08.460 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 33/36 2026-02-26T02:56:08.496 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-26T02:56:08.498 INFO:teuthology.orchestra.run.trial191.stdout: Upgrading : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/36 2026-02-26T02:56:08.523 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/36 2026-02-26T02:56:08.525 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 20/36 2026-02-26T02:56:08.531 INFO:teuthology.orchestra.run.trial191.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-26T02:56:08.755 INFO:teuthology.orchestra.run.trial191.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-26T02:56:08.756 INFO:teuthology.orchestra.run.trial191.stdout: Installing : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/36 2026-02-26T02:56:08.772 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/36 2026-02-26T02:56:08.776 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 24/36 2026-02-26T02:56:08.780 INFO:teuthology.orchestra.run.trial191.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-26T02:56:08.783 INFO:teuthology.orchestra.run.trial191.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-26T02:56:08.783 INFO:teuthology.orchestra.run.trial191.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-26T02:56:08.799 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-26T02:56:08.802 INFO:teuthology.orchestra.run.trial191.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-26T02:56:08.828 INFO:teuthology.orchestra.run.trial191.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-26T02:56:08.829 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 30/36 2026-02-26T02:56:09.809 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 31/36 2026-02-26T02:56:09.811 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 31/36 2026-02-26T02:56:10.091 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 31/36 2026-02-26T02:56:10.094 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 32/36 2026-02-26T02:56:10.131 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 32/36 2026-02-26T02:56:10.131 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-26T02:56:10.131 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-26T02:56:10.131 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:10.134 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 33/36 2026-02-26T02:56:12.944 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 33/36 2026-02-26T02:56:12.944 INFO:teuthology.orchestra.run.trial190.stdout:skipping the directory /sys 2026-02-26T02:56:12.944 INFO:teuthology.orchestra.run.trial190.stdout:skipping the directory /proc 2026-02-26T02:56:12.944 INFO:teuthology.orchestra.run.trial190.stdout:skipping the directory /mnt 2026-02-26T02:56:12.945 INFO:teuthology.orchestra.run.trial190.stdout:skipping the directory /var/tmp 2026-02-26T02:56:12.945 INFO:teuthology.orchestra.run.trial190.stdout:skipping the directory /home 2026-02-26T02:56:12.945 INFO:teuthology.orchestra.run.trial190.stdout:skipping the directory /root 2026-02-26T02:56:12.945 INFO:teuthology.orchestra.run.trial190.stdout:skipping the directory /tmp 2026-02-26T02:56:12.945 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:13.407 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 34/36 2026-02-26T02:56:13.431 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 34/36 2026-02-26T02:56:13.431 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:13.431 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-26T02:56:13.432 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:56:13.432 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:56:13.432 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:13.433 INFO:teuthology.orchestra.run.trial190.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-26T02:56:13.446 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-26T02:56:13.446 INFO:teuthology.orchestra.run.trial190.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-26T02:56:13.504 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-26T02:56:13.504 INFO:teuthology.orchestra.run.trial190.stdout:Creating group 'qat' with GID 992. 2026-02-26T02:56:13.504 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 1/36 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2/36 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 3/36 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 4/36 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 5/36 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 6/36 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 7/36 2026-02-26T02:56:13.783 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 8/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 9/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 11/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 12/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 13/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-26T02:56:13.784 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-26T02:56:13.785 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-26T02:56:13.786 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librados2-2:19.2.3-687.g8d724284.el9.x86_64 33/36 2026-02-26T02:56:13.786 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-26T02:56:13.786 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 35/36 2026-02-26T02:56:13.848 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-26T02:56:13.848 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:13.848 INFO:teuthology.orchestra.run.trial190.stdout:Upgraded: 2026-02-26T02:56:13.848 INFO:teuthology.orchestra.run.trial190.stdout: librados2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.848 INFO:teuthology.orchestra.run.trial190.stdout: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.848 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:13.849 INFO:teuthology.orchestra.run.trial190.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-26T02:56:13.849 INFO:teuthology.orchestra.run.trial190.stdout: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.849 INFO:teuthology.orchestra.run.trial190.stdout: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.849 INFO:teuthology.orchestra.run.trial190.stdout: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.849 INFO:teuthology.orchestra.run.trial190.stdout: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-26T02:56:13.850 INFO:teuthology.orchestra.run.trial190.stdout: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.851 INFO:teuthology.orchestra.run.trial190.stdout: python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: re2-1:20211101-20.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-26T02:56:13.852 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:13.853 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:13.889 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-test 2026-02-26T02:56:14.204 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:14 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:14.287 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repository Size 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: ceph-test x86_64 2:19.2.3-687.g8d724284.el9 ceph 51 M 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:Installing dependencies: 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: libcephsqlite x86_64 2:19.2.3-687.g8d724284.el9 ceph 163 k 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:Install 5 Packages 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 51 M 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 222 M 2026-02-26T02:56:14.288 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:14.401 INFO:teuthology.orchestra.run.trial190.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 7.4 MB/s | 233 kB 00:00 2026-02-26T02:56:14.413 INFO:teuthology.orchestra.run.trial190.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 25 MB/s | 303 kB 00:00 2026-02-26T02:56:14.418 INFO:teuthology.orchestra.run.trial190.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-26T02:56:14.615 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 33/36 2026-02-26T02:56:14.615 INFO:teuthology.orchestra.run.trial191.stdout:skipping the directory /sys 2026-02-26T02:56:14.616 INFO:teuthology.orchestra.run.trial191.stdout:skipping the directory /proc 2026-02-26T02:56:14.616 INFO:teuthology.orchestra.run.trial191.stdout:skipping the directory /mnt 2026-02-26T02:56:14.616 INFO:teuthology.orchestra.run.trial191.stdout:skipping the directory /var/tmp 2026-02-26T02:56:14.616 INFO:teuthology.orchestra.run.trial191.stdout:skipping the directory /home 2026-02-26T02:56:14.616 INFO:teuthology.orchestra.run.trial191.stdout:skipping the directory /root 2026-02-26T02:56:14.616 INFO:teuthology.orchestra.run.trial191.stdout:skipping the directory /tmp 2026-02-26T02:56:14.616 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:14.743 INFO:teuthology.orchestra.run.trial190.stdout:(4/5): libcephsqlite-19.2.3-687.g8d724284.el9.x 439 kB/s | 163 kB 00:00 2026-02-26T02:56:15.070 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 34/36 2026-02-26T02:56:15.093 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 34/36 2026-02-26T02:56:15.093 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:15.093 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-26T02:56:15.093 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:56:15.093 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:56:15.093 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:15.095 INFO:teuthology.orchestra.run.trial191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-26T02:56:15.107 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-26T02:56:15.107 INFO:teuthology.orchestra.run.trial191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-26T02:56:15.166 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-26T02:56:15.166 INFO:teuthology.orchestra.run.trial191.stdout:Creating group 'qat' with GID 992. 2026-02-26T02:56:15.166 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 1/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 3/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 4/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 5/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 6/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 7/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 8/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 9/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 11/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 12/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 13/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-26T02:56:15.451 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librados2-2:19.2.3-687.g8d724284.el9.x86_64 33/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-26T02:56:15.452 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 35/36 2026-02-26T02:56:15.519 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout:Upgraded: 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout: librados2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.520 INFO:teuthology.orchestra.run.trial191.stdout: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-26T02:56:15.521 INFO:teuthology.orchestra.run.trial191.stdout: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.522 INFO:teuthology.orchestra.run.trial191.stdout: python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: re2-1:20211101-20.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:15.523 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:15.562 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-test 2026-02-26T02:56:15.883 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:14 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:15.968 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repository Size 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: ceph-test x86_64 2:19.2.3-687.g8d724284.el9 ceph 51 M 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout:Installing dependencies: 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: libcephsqlite x86_64 2:19.2.3-687.g8d724284.el9 ceph 163 k 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout:Install 5 Packages 2026-02-26T02:56:15.969 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:15.970 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 51 M 2026-02-26T02:56:15.970 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 222 M 2026-02-26T02:56:15.970 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:56:16.444 INFO:teuthology.orchestra.run.trial191.stdout:(1/5): libcephsqlite-19.2.3-687.g8d724284.el9.x 422 kB/s | 163 kB 00:00 2026-02-26T02:56:16.701 INFO:teuthology.orchestra.run.trial191.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 362 kB/s | 233 kB 00:00 2026-02-26T02:56:16.785 INFO:teuthology.orchestra.run.trial191.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2026-02-26T02:56:17.084 INFO:teuthology.orchestra.run.trial191.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 474 kB/s | 303 kB 00:00 2026-02-26T02:56:17.291 INFO:teuthology.orchestra.run.trial190.stdout:(5/5): ceph-test-19.2.3-687.g8d724284.el9.x86_6 17 MB/s | 51 MB 00:02 2026-02-26T02:56:17.293 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:17.293 INFO:teuthology.orchestra.run.trial190.stdout:Total 17 MB/s | 51 MB 00:03 2026-02-26T02:56:17.319 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:17.328 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:17.328 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:17.518 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:17.519 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:17.734 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:17.740 INFO:teuthology.orchestra.run.trial190.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-26T02:56:17.744 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-26T02:56:17.752 INFO:teuthology.orchestra.run.trial190.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-26T02:56:17.753 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:56:20.004 INFO:teuthology.orchestra.run.trial191.stdout:(5/5): ceph-test-19.2.3-687.g8d724284.el9.x86_6 13 MB/s | 51 MB 00:03 2026-02-26T02:56:20.005 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:20.006 INFO:teuthology.orchestra.run.trial191.stdout:Total 13 MB/s | 51 MB 00:04 2026-02-26T02:56:20.034 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:56:20.043 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:56:20.043 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:56:20.156 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:56:20.175 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:56:20.231 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:56:20.231 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:56:20.395 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:56:20.395 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 1/5 2026-02-26T02:56:20.395 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2/5 2026-02-26T02:56:20.395 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-26T02:56:20.395 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-26T02:56:20.446 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:56:20.452 INFO:teuthology.orchestra.run.trial191.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-26T02:56:20.453 INFO:teuthology.orchestra.run.trial190.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-26T02:56:20.454 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:20.454 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:20.457 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-26T02:56:20.465 INFO:teuthology.orchestra.run.trial191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-26T02:56:20.466 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:56:20.486 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph 2026-02-26T02:56:20.802 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:20 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:20.889 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout:====================================================================================== 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repository Size 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout:====================================================================================== 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.5 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout:Installing dependencies: 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph-grafana-dashboards noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 31 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mds x86_64 2:19.2.3-687.g8d724284.el9 ceph 2.4 M 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-modules-core noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 253 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mon x86_64 2:19.2.3-687.g8d724284.el9 ceph 4.7 M 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph-osd x86_64 2:19.2.3-687.g8d724284.el9 ceph 17 M 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: ceph-prometheus-alerts noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 17 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 769 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-26T02:56:20.892 INFO:teuthology.orchestra.run.trial190.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-26T02:56:20.893 INFO:teuthology.orchestra.run.trial190.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-26T02:56:20.894 INFO:teuthology.orchestra.run.trial190.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout:Installing weak dependencies: 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 150 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-dashboard noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 3.8 M 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 7.4 M 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 22 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-rook noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 49 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: ceph-volume noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 299 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-26T02:56:20.895 INFO:teuthology.orchestra.run.trial190.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout:====================================================================================== 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout:Install 98 Packages 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 95 M 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 519 M 2026-02-26T02:56:20.896 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:21.613 INFO:teuthology.orchestra.run.trial190.stdout:(1/98): ceph-19.2.3-687.g8d724284.el9.x86_64.rp 32 kB/s | 6.5 kB 00:00 2026-02-26T02:56:21.994 INFO:teuthology.orchestra.run.trial190.stdout:(2/98): ceph-mgr-19.2.3-687.g8d724284.el9.x86_6 1.8 MB/s | 1.1 MB 00:00 2026-02-26T02:56:22.240 INFO:teuthology.orchestra.run.trial190.stdout:(3/98): ceph-mds-19.2.3-687.g8d724284.el9.x86_6 2.9 MB/s | 2.4 MB 00:00 2026-02-26T02:56:22.300 INFO:teuthology.orchestra.run.trial190.stdout:(4/98): ceph-grafana-dashboards-19.2.3-687.g8d7 515 kB/s | 31 kB 00:00 2026-02-26T02:56:22.364 INFO:teuthology.orchestra.run.trial190.stdout:(5/98): ceph-mgr-cephadm-19.2.3-687.g8d724284.e 2.3 MB/s | 150 kB 00:00 2026-02-26T02:56:22.815 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:56:22.834 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:56:23.079 INFO:teuthology.orchestra.run.trial190.stdout:(6/98): ceph-mgr-dashboard-19.2.3-687.g8d724284 5.3 MB/s | 3.8 MB 00:00 2026-02-26T02:56:23.090 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:56:23.090 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 1/5 2026-02-26T02:56:23.090 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2/5 2026-02-26T02:56:23.090 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-26T02:56:23.090 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-26T02:56:23.148 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-26T02:56:23.148 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:23.148 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:56:23.148 INFO:teuthology.orchestra.run.trial191.stdout: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:23.149 INFO:teuthology.orchestra.run.trial191.stdout: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:23.149 INFO:teuthology.orchestra.run.trial191.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-26T02:56:23.149 INFO:teuthology.orchestra.run.trial191.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-26T02:56:23.149 INFO:teuthology.orchestra.run.trial191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-26T02:56:23.149 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:23.149 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:23.180 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph 2026-02-26T02:56:23.402 INFO:teuthology.orchestra.run.trial190.stdout:(7/98): ceph-mon-19.2.3-687.g8d724284.el9.x86_6 2.6 MB/s | 4.7 MB 00:01 2026-02-26T02:56:23.436 INFO:teuthology.orchestra.run.trial190.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-687.g8d724284 655 kB/s | 22 kB 00:00 2026-02-26T02:56:23.474 INFO:teuthology.orchestra.run.trial190.stdout:(9/98): ceph-mgr-modules-core-19.2.3-687.g8d724 6.5 MB/s | 253 kB 00:00 2026-02-26T02:56:23.494 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:22 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:23.508 INFO:teuthology.orchestra.run.trial190.stdout:(10/98): ceph-mgr-rook-19.2.3-687.g8d724284.el9 1.4 MB/s | 49 kB 00:00 2026-02-26T02:56:23.543 INFO:teuthology.orchestra.run.trial190.stdout:(11/98): ceph-prometheus-alerts-19.2.3-687.g8d7 489 kB/s | 17 kB 00:00 2026-02-26T02:56:23.581 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:23.582 INFO:teuthology.orchestra.run.trial190.stdout:(12/98): ceph-volume-19.2.3-687.g8d724284.el9.n 7.5 MB/s | 299 kB 00:00 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout:====================================================================================== 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repository Size 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout:====================================================================================== 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout: ceph x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.5 k 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout:Installing dependencies: 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout: ceph-grafana-dashboards noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 31 k 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mds x86_64 2:19.2.3-687.g8d724284.el9 ceph 2.4 M 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:56:23.584 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-modules-core noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 253 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mon x86_64 2:19.2.3-687.g8d724284.el9 ceph 4.7 M 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: ceph-osd x86_64 2:19.2.3-687.g8d724284.el9 ceph 17 M 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: ceph-prometheus-alerts noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 17 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 769 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-26T02:56:23.585 INFO:teuthology.orchestra.run.trial191.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-26T02:56:23.586 INFO:teuthology.orchestra.run.trial191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-26T02:56:23.587 INFO:teuthology.orchestra.run.trial191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-26T02:56:23.588 INFO:teuthology.orchestra.run.trial191.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-26T02:56:23.589 INFO:teuthology.orchestra.run.trial191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-26T02:56:23.589 INFO:teuthology.orchestra.run.trial191.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-26T02:56:23.589 INFO:teuthology.orchestra.run.trial191.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-26T02:56:23.589 INFO:teuthology.orchestra.run.trial191.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-26T02:56:23.589 INFO:teuthology.orchestra.run.trial191.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-26T02:56:23.589 INFO:teuthology.orchestra.run.trial191.stdout:Installing weak dependencies: 2026-02-26T02:56:23.589 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 150 k 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-dashboard noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 3.8 M 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 7.4 M 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 22 k 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-rook noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 49 k 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: ceph-volume noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 299 k 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:23.590 INFO:teuthology.orchestra.run.trial191.stdout:====================================================================================== 2026-02-26T02:56:23.591 INFO:teuthology.orchestra.run.trial191.stdout:Install 98 Packages 2026-02-26T02:56:23.591 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:23.592 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 95 M 2026-02-26T02:56:23.592 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 519 M 2026-02-26T02:56:23.592 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:56:23.701 INFO:teuthology.orchestra.run.trial190.stdout:(13/98): cephadm-19.2.3-687.g8d724284.el9.noarc 6.3 MB/s | 769 kB 00:00 2026-02-26T02:56:23.828 INFO:teuthology.orchestra.run.trial190.stdout:(14/98): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.7 MB/s | 351 kB 00:00 2026-02-26T02:56:23.948 INFO:teuthology.orchestra.run.trial190.stdout:(15/98): ceph-mgr-diskprediction-local-19.2.3-6 8.5 MB/s | 7.4 MB 00:00 2026-02-26T02:56:24.036 INFO:teuthology.orchestra.run.trial190.stdout:(16/98): libconfig-1.7.2-9.el9.x86_64.rpm 825 kB/s | 72 kB 00:00 2026-02-26T02:56:24.050 INFO:teuthology.orchestra.run.trial190.stdout:(17/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 182 kB/s | 40 kB 00:00 2026-02-26T02:56:24.209 INFO:teuthology.orchestra.run.trial190.stdout:(18/98): libgfortran-11.5.0-14.el9.x86_64.rpm 4.5 MB/s | 794 kB 00:00 2026-02-26T02:56:24.231 INFO:teuthology.orchestra.run.trial190.stdout:(19/98): ceph-osd-19.2.3-687.g8d724284.el9.x86_ 7.6 MB/s | 17 MB 00:02 2026-02-26T02:56:24.328 INFO:teuthology.orchestra.run.trial191.stdout:(1/98): ceph-19.2.3-687.g8d724284.el9.x86_64.rp 53 kB/s | 6.5 kB 00:00 2026-02-26T02:56:24.352 INFO:teuthology.orchestra.run.trial190.stdout:(20/98): libquadmath-11.5.0-14.el9.x86_64.rpm 612 kB/s | 184 kB 00:00 2026-02-26T02:56:24.409 INFO:teuthology.orchestra.run.trial190.stdout:(21/98): python3-cryptography-36.0.1-5.el9.x86_ 7.0 MB/s | 1.2 MB 00:00 2026-02-26T02:56:24.420 INFO:teuthology.orchestra.run.trial190.stdout:(22/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2026-02-26T02:56:24.435 INFO:teuthology.orchestra.run.trial190.stdout:(23/98): python3-pycparser-2.20-6.el9.noarch.rp 5.2 MB/s | 135 kB 00:00 2026-02-26T02:56:24.445 INFO:teuthology.orchestra.run.trial190.stdout:(24/98): python3-requests-2.25.1-10.el9.noarch. 5.0 MB/s | 126 kB 00:00 2026-02-26T02:56:24.459 INFO:teuthology.orchestra.run.trial190.stdout:(25/98): python3-urllib3-1.26.5-7.el9.noarch.rp 9.0 MB/s | 218 kB 00:00 2026-02-26T02:56:24.468 INFO:teuthology.orchestra.run.trial190.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 7.8 MB/s | 182 kB 00:00 2026-02-26T02:56:24.483 INFO:teuthology.orchestra.run.trial190.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 10 MB/s | 266 kB 00:00 2026-02-26T02:56:24.637 INFO:teuthology.orchestra.run.trial191.stdout:(2/98): ceph-mgr-19.2.3-687.g8d724284.el9.x86_6 2.5 MB/s | 1.1 MB 00:00 2026-02-26T02:56:24.913 INFO:teuthology.orchestra.run.trial190.stdout:(28/98): python3-ply-3.11-14.el9.noarch.rpm 190 kB/s | 106 kB 00:00 2026-02-26T02:56:25.023 INFO:teuthology.orchestra.run.trial190.stdout:(29/98): flexiblas-3.0.4-9.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2026-02-26T02:56:25.175 INFO:teuthology.orchestra.run.trial191.stdout:(3/98): ceph-mds-19.2.3-687.g8d724284.el9.x86_6 2.5 MB/s | 2.4 MB 00:00 2026-02-26T02:56:25.223 INFO:teuthology.orchestra.run.trial191.stdout:(4/98): ceph-grafana-dashboards-19.2.3-687.g8d7 648 kB/s | 31 kB 00:00 2026-02-26T02:56:25.277 INFO:teuthology.orchestra.run.trial191.stdout:(5/98): ceph-mgr-cephadm-19.2.3-687.g8d724284.e 2.7 MB/s | 150 kB 00:00 2026-02-26T02:56:25.338 INFO:teuthology.orchestra.run.trial190.stdout:(30/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 784 kB/s | 246 kB 00:00 2026-02-26T02:56:25.387 INFO:teuthology.orchestra.run.trial190.stdout:(31/98): flexiblas-openblas-openmp-3.0.4-9.el9. 31 kB/s | 15 kB 00:00 2026-02-26T02:56:25.497 INFO:teuthology.orchestra.run.trial190.stdout:(32/98): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2026-02-26T02:56:25.520 INFO:teuthology.orchestra.run.trial190.stdout:(33/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.9 MB/s | 3.0 MB 00:01 2026-02-26T02:56:25.623 INFO:teuthology.orchestra.run.trial190.stdout:(34/98): openblas-0.3.29-1.el9.x86_64.rpm 178 kB/s | 42 kB 00:00 2026-02-26T02:56:25.687 INFO:teuthology.orchestra.run.trial190.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2026-02-26T02:56:25.902 INFO:teuthology.orchestra.run.trial190.stdout:(36/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 13 MB/s | 5.3 MB 00:00 2026-02-26T02:56:26.001 INFO:teuthology.orchestra.run.trial190.stdout:(37/98): python3-devel-3.9.25-3.el9.x86_64.rpm 780 kB/s | 244 kB 00:00 2026-02-26T02:56:26.062 INFO:teuthology.orchestra.run.trial190.stdout:(38/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-26T02:56:26.160 INFO:teuthology.orchestra.run.trial190.stdout:(39/98): python3-libstoragemgmt-1.10.1-1.el9.x8 1.1 MB/s | 177 kB 00:00 2026-02-26T02:56:26.212 INFO:teuthology.orchestra.run.trial191.stdout:(6/98): ceph-mon-19.2.3-687.g8d724284.el9.x86_6 2.5 MB/s | 4.7 MB 00:01 2026-02-26T02:56:26.318 INFO:teuthology.orchestra.run.trial190.stdout:(40/98): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2026-02-26T02:56:26.326 INFO:teuthology.orchestra.run.trial191.stdout:(7/98): ceph-mgr-dashboard-19.2.3-687.g8d724284 3.6 MB/s | 3.8 MB 00:01 2026-02-26T02:56:26.379 INFO:teuthology.orchestra.run.trial191.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-687.g8d724284 414 kB/s | 22 kB 00:00 2026-02-26T02:56:26.381 INFO:teuthology.orchestra.run.trial190.stdout:(41/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 3.8 MB/s | 1.2 MB 00:00 2026-02-26T02:56:26.477 INFO:teuthology.orchestra.run.trial190.stdout:(42/98): python3-markupsafe-1.1.1-12.el9.x86_64 219 kB/s | 35 kB 00:00 2026-02-26T02:56:26.493 INFO:teuthology.orchestra.run.trial191.stdout:(9/98): ceph-mgr-modules-core-19.2.3-687.g8d724 2.2 MB/s | 253 kB 00:00 2026-02-26T02:56:26.549 INFO:teuthology.orchestra.run.trial191.stdout:(10/98): ceph-osd-19.2.3-687.g8d724284.el9.x86_ 8.9 MB/s | 17 MB 00:01 2026-02-26T02:56:26.549 INFO:teuthology.orchestra.run.trial191.stdout:(11/98): ceph-mgr-rook-19.2.3-687.g8d724284.el9 882 kB/s | 49 kB 00:00 2026-02-26T02:56:26.591 INFO:teuthology.orchestra.run.trial191.stdout:(12/98): ceph-prometheus-alerts-19.2.3-687.g8d7 393 kB/s | 17 kB 00:00 2026-02-26T02:56:26.637 INFO:teuthology.orchestra.run.trial190.stdout:(43/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.7 MB/s | 442 kB 00:00 2026-02-26T02:56:26.644 INFO:teuthology.orchestra.run.trial191.stdout:(13/98): ceph-volume-19.2.3-687.g8d724284.el9.n 3.1 MB/s | 299 kB 00:00 2026-02-26T02:56:26.651 INFO:teuthology.orchestra.run.trial191.stdout:(14/98): cephadm-19.2.3-687.g8d724284.el9.noarc 13 MB/s | 769 kB 00:00 2026-02-26T02:56:26.709 INFO:teuthology.orchestra.run.trial190.stdout:(44/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 19 MB/s | 6.1 MB 00:00 2026-02-26T02:56:26.795 INFO:teuthology.orchestra.run.trial190.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 487 kB/s | 77 kB 00:00 2026-02-26T02:56:26.803 INFO:teuthology.orchestra.run.trial190.stdout:(46/98): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2026-02-26T02:56:26.869 INFO:teuthology.orchestra.run.trial190.stdout:(47/98): python3-protobuf-3.14.0-17.el9.noarch. 1.6 MB/s | 267 kB 00:00 2026-02-26T02:56:26.954 INFO:teuthology.orchestra.run.trial190.stdout:(48/98): python3-pyasn1-0.4.8-7.el9.noarch.rpm 992 kB/s | 157 kB 00:00 2026-02-26T02:56:26.963 INFO:teuthology.orchestra.run.trial190.stdout:(49/98): python3-pyasn1-modules-0.4.8-7.el9.noa 1.7 MB/s | 277 kB 00:00 2026-02-26T02:56:27.105 INFO:teuthology.orchestra.run.trial190.stdout:(50/98): python3-requests-oauthlib-1.3.0-12.el9 227 kB/s | 54 kB 00:00 2026-02-26T02:56:27.121 INFO:teuthology.orchestra.run.trial190.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 263 kB/s | 42 kB 00:00 2026-02-26T02:56:27.185 INFO:teuthology.orchestra.run.trial191.stdout:(15/98): ceph-mgr-diskprediction-local-19.2.3-6 7.6 MB/s | 7.4 MB 00:00 2026-02-26T02:56:27.259 INFO:teuthology.orchestra.run.trial191.stdout:(16/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 67 kB/s | 40 kB 00:00 2026-02-26T02:56:27.263 INFO:teuthology.orchestra.run.trial190.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.2 MB/s | 189 kB 00:00 2026-02-26T02:56:27.281 INFO:teuthology.orchestra.run.trial190.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 567 kB/s | 90 kB 00:00 2026-02-26T02:56:27.336 INFO:teuthology.orchestra.run.trial190.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 307 kB/s | 22 kB 00:00 2026-02-26T02:56:27.385 INFO:teuthology.orchestra.run.trial190.stdout:(55/98): protobuf-compiler-3.14.0-17.el9.x86_64 8.1 MB/s | 862 kB 00:00 2026-02-26T02:56:27.438 INFO:teuthology.orchestra.run.trial190.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 365 kB/s | 19 kB 00:00 2026-02-26T02:56:27.500 INFO:teuthology.orchestra.run.trial190.stdout:(57/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 35 MB/s | 19 MB 00:00 2026-02-26T02:56:27.501 INFO:teuthology.orchestra.run.trial190.stdout:(58/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.3 MB/s | 551 kB 00:00 2026-02-26T02:56:27.502 INFO:teuthology.orchestra.run.trial191.stdout:(17/98): cryptsetup-2.8.1-3.el9.x86_64.rpm 409 kB/s | 351 kB 00:00 2026-02-26T02:56:27.536 INFO:teuthology.orchestra.run.trial190.stdout:(59/98): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2026-02-26T02:56:27.537 INFO:teuthology.orchestra.run.trial190.stdout:(60/98): python3-autocommand-2.2.2-8.el9.noarch 826 kB/s | 29 kB 00:00 2026-02-26T02:56:27.567 INFO:teuthology.orchestra.run.trial190.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 1.9 MB/s | 60 kB 00:00 2026-02-26T02:56:27.574 INFO:teuthology.orchestra.run.trial190.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.2 MB/s | 43 kB 00:00 2026-02-26T02:56:27.592 INFO:teuthology.orchestra.run.trial190.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 1.3 MB/s | 32 kB 00:00 2026-02-26T02:56:27.599 INFO:teuthology.orchestra.run.trial190.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 571 kB/s | 14 kB 00:00 2026-02-26T02:56:27.631 INFO:teuthology.orchestra.run.trial190.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 4.3 MB/s | 173 kB 00:00 2026-02-26T02:56:27.636 INFO:teuthology.orchestra.run.trial190.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 9.5 MB/s | 358 kB 00:00 2026-02-26T02:56:27.639 INFO:teuthology.orchestra.run.trial190.stdout:(67/98): python3-asyncssh-2.13.2-5.el9.noarch.r 3.8 MB/s | 548 kB 00:00 2026-02-26T02:56:27.668 INFO:teuthology.orchestra.run.trial190.stdout:(68/98): python3-google-auth-2.45.0-1.el9.noarc 6.7 MB/s | 254 kB 00:00 2026-02-26T02:56:27.675 INFO:teuthology.orchestra.run.trial190.stdout:(69/98): python3-grpcio-tools-1.46.7-10.el9.x86 4.0 MB/s | 144 kB 00:00 2026-02-26T02:56:27.698 INFO:teuthology.orchestra.run.trial190.stdout:(70/98): python3-influxdb-5.3.1-1.el9.noarch.rp 4.7 MB/s | 139 kB 00:00 2026-02-26T02:56:27.700 INFO:teuthology.orchestra.run.trial190.stdout:(71/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 32 MB/s | 2.0 MB 00:00 2026-02-26T02:56:27.701 INFO:teuthology.orchestra.run.trial190.stdout:(72/98): python3-isodate-0.6.1-3.el9.noarch.rpm 2.2 MB/s | 56 kB 00:00 2026-02-26T02:56:27.715 INFO:teuthology.orchestra.run.trial190.stdout:(73/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 608 kB/s | 11 kB 00:00 2026-02-26T02:56:27.719 INFO:teuthology.orchestra.run.trial190.stdout:(74/98): python3-jaraco-classes-3.2.1-5.el9.noa 949 kB/s | 18 kB 00:00 2026-02-26T02:56:27.719 INFO:teuthology.orchestra.run.trial190.stdout:(75/98): python3-jaraco-collections-3.0.0-8.el9 1.2 MB/s | 23 kB 00:00 2026-02-26T02:56:27.733 INFO:teuthology.orchestra.run.trial190.stdout:(76/98): python3-jaraco-context-6.0.1-3.el9.noa 1.1 MB/s | 20 kB 00:00 2026-02-26T02:56:27.737 INFO:teuthology.orchestra.run.trial190.stdout:(77/98): python3-jaraco-functools-3.5.0-2.el9.n 1.0 MB/s | 19 kB 00:00 2026-02-26T02:56:27.747 INFO:teuthology.orchestra.run.trial190.stdout:(78/98): python3-jaraco-text-4.0.0-2.el9.noarch 956 kB/s | 26 kB 00:00 2026-02-26T02:56:27.778 INFO:teuthology.orchestra.run.trial190.stdout:(79/98): python3-more-itertools-8.12.0-2.el9.no 2.4 MB/s | 79 kB 00:00 2026-02-26T02:56:27.788 INFO:teuthology.orchestra.run.trial190.stdout:(80/98): python3-logutils-0.3.5-21.el9.noarch.r 905 kB/s | 46 kB 00:00 2026-02-26T02:56:27.794 INFO:teuthology.orchestra.run.trial190.stdout:(81/98): python3-kubernetes-26.1.0-3.el9.noarch 17 MB/s | 1.0 MB 00:00 2026-02-26T02:56:27.806 INFO:teuthology.orchestra.run.trial190.stdout:(82/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2026-02-26T02:56:27.814 INFO:teuthology.orchestra.run.trial190.stdout:(83/98): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2026-02-26T02:56:27.825 INFO:teuthology.orchestra.run.trial190.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 8.6 MB/s | 272 kB 00:00 2026-02-26T02:56:27.833 INFO:teuthology.orchestra.run.trial190.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.5 MB/s | 90 kB 00:00 2026-02-26T02:56:27.835 INFO:teuthology.orchestra.run.trial190.stdout:(86/98): python3-portend-3.1.0-2.el9.noarch.rpm 568 kB/s | 16 kB 00:00 2026-02-26T02:56:27.850 INFO:teuthology.orchestra.run.trial190.stdout:(87/98): python3-repoze-lru-0.7-16.el9.noarch.r 1.2 MB/s | 31 kB 00:00 2026-02-26T02:56:27.852 INFO:teuthology.orchestra.run.trial191.stdout:(18/98): libconfig-1.7.2-9.el9.x86_64.rpm 108 kB/s | 72 kB 00:00 2026-02-26T02:56:27.861 INFO:teuthology.orchestra.run.trial190.stdout:(88/98): python3-routes-2.5.1-5.el9.noarch.rpm 6.6 MB/s | 188 kB 00:00 2026-02-26T02:56:27.870 INFO:teuthology.orchestra.run.trial190.stdout:(89/98): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-26T02:56:27.879 INFO:teuthology.orchestra.run.trial190.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 4.1 MB/s | 125 kB 00:00 2026-02-26T02:56:27.889 INFO:teuthology.orchestra.run.trial190.stdout:(91/98): python3-tempora-5.0.0-2.el9.noarch.rpm 1.2 MB/s | 36 kB 00:00 2026-02-26T02:56:27.899 INFO:teuthology.orchestra.run.trial190.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 2.9 MB/s | 86 kB 00:00 2026-02-26T02:56:27.904 INFO:teuthology.orchestra.run.trial190.stdout:(93/98): python3-webob-1.8.8-2.el9.noarch.rpm 9.3 MB/s | 230 kB 00:00 2026-02-26T02:56:27.920 INFO:teuthology.orchestra.run.trial190.stdout:(94/98): python3-websocket-client-1.2.3-2.el9.n 2.9 MB/s | 90 kB 00:00 2026-02-26T02:56:27.928 INFO:teuthology.orchestra.run.trial190.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.0 MB/s | 48 kB 00:00 2026-02-26T02:56:27.929 INFO:teuthology.orchestra.run.trial190.stdout:(96/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 14 MB/s | 427 kB 00:00 2026-02-26T02:56:27.945 INFO:teuthology.orchestra.run.trial190.stdout:(97/98): python3-xmltodict-0.12.0-15.el9.noarch 888 kB/s | 22 kB 00:00 2026-02-26T02:56:27.953 INFO:teuthology.orchestra.run.trial190.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 783 kB/s | 20 kB 00:00 2026-02-26T02:56:27.955 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:27.955 INFO:teuthology.orchestra.run.trial190.stdout:Total 13 MB/s | 95 MB 00:07 2026-02-26T02:56:28.203 INFO:teuthology.orchestra.run.trial191.stdout:(19/98): libgfortran-11.5.0-14.el9.x86_64.rpm 841 kB/s | 794 kB 00:00 2026-02-26T02:56:28.257 INFO:teuthology.orchestra.run.trial191.stdout:(20/98): libquadmath-11.5.0-14.el9.x86_64.rpm 245 kB/s | 184 kB 00:00 2026-02-26T02:56:28.383 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:28.421 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:28.421 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:28.643 INFO:teuthology.orchestra.run.trial191.stdout:(21/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 320 kB/s | 253 kB 00:00 2026-02-26T02:56:28.841 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:28.841 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:28.971 INFO:teuthology.orchestra.run.trial191.stdout:(22/98): python3-ply-3.11-14.el9.noarch.rpm 149 kB/s | 106 kB 00:00 2026-02-26T02:56:29.221 INFO:teuthology.orchestra.run.trial191.stdout:(23/98): python3-cryptography-36.0.1-5.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2026-02-26T02:56:29.292 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:29.294 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-26T02:56:29.325 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-26T02:56:29.329 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-26T02:56:29.351 INFO:teuthology.orchestra.run.trial190.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-26T02:56:29.362 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/98 2026-02-26T02:56:29.367 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-26T02:56:29.386 INFO:teuthology.orchestra.run.trial191.stdout:(24/98): python3-pycparser-2.20-6.el9.noarch.rp 182 kB/s | 135 kB 00:00 2026-02-26T02:56:29.400 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-26T02:56:29.409 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-26T02:56:29.414 INFO:teuthology.orchestra.run.trial190.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-26T02:56:29.417 INFO:teuthology.orchestra.run.trial190.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-26T02:56:29.421 INFO:teuthology.orchestra.run.trial190.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-26T02:56:29.445 INFO:teuthology.orchestra.run.trial190.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-26T02:56:29.457 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-26T02:56:29.460 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-26T02:56:29.466 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-26T02:56:29.468 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-26T02:56:29.479 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-26T02:56:29.485 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-26T02:56:29.509 INFO:teuthology.orchestra.run.trial190.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-26T02:56:29.512 INFO:teuthology.orchestra.run.trial190.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-26T02:56:29.519 INFO:teuthology.orchestra.run.trial190.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-26T02:56:29.544 INFO:teuthology.orchestra.run.trial190.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-26T02:56:29.596 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-26T02:56:29.608 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 24/98 2026-02-26T02:56:29.611 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-26T02:56:29.615 INFO:teuthology.orchestra.run.trial190.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-26T02:56:29.620 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-26T02:56:29.625 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-26T02:56:29.628 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-26T02:56:29.643 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-26T02:56:29.664 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-26T02:56:29.668 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-26T02:56:29.673 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-26T02:56:29.684 INFO:teuthology.orchestra.run.trial191.stdout:(25/98): python3-requests-2.25.1-10.el9.noarch. 177 kB/s | 126 kB 00:00 2026-02-26T02:56:29.685 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-26T02:56:29.693 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-26T02:56:29.700 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-26T02:56:29.720 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-26T02:56:29.728 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-26T02:56:29.783 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-26T02:56:29.795 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-26T02:56:29.810 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-26T02:56:29.815 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-26T02:56:29.822 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-26T02:56:29.863 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-26T02:56:30.016 INFO:teuthology.orchestra.run.trial191.stdout:(26/98): python3-urllib3-1.26.5-7.el9.noarch.rp 274 kB/s | 218 kB 00:00 2026-02-26T02:56:30.146 INFO:teuthology.orchestra.run.trial191.stdout:(27/98): unzip-6.0-59.el9.x86_64.rpm 239 kB/s | 182 kB 00:00 2026-02-26T02:56:30.189 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-26T02:56:30.199 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-26T02:56:30.202 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-26T02:56:30.208 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-26T02:56:30.210 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-26T02:56:30.238 INFO:teuthology.orchestra.run.trial190.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-26T02:56:30.282 INFO:teuthology.orchestra.run.trial190.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-26T02:56:30.289 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-26T02:56:30.293 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-26T02:56:30.298 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-26T02:56:30.302 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-26T02:56:30.309 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-26T02:56:30.312 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-26T02:56:30.340 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-26T02:56:30.350 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-26T02:56:30.385 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-26T02:56:30.610 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 61/98 2026-02-26T02:56:30.634 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-26T02:56:30.638 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-26T02:56:30.696 INFO:teuthology.orchestra.run.trial190.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-26T02:56:30.698 INFO:teuthology.orchestra.run.trial190.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-26T02:56:30.708 INFO:teuthology.orchestra.run.trial191.stdout:(28/98): flexiblas-3.0.4-9.el9.x86_64.rpm 43 kB/s | 30 kB 00:00 2026-02-26T02:56:30.719 INFO:teuthology.orchestra.run.trial190.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-26T02:56:30.868 INFO:teuthology.orchestra.run.trial191.stdout:(29/98): flexiblas-openblas-openmp-3.0.4-9.el9. 93 kB/s | 15 kB 00:00 2026-02-26T02:56:31.044 INFO:teuthology.orchestra.run.trial190.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-26T02:56:31.117 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-26T02:56:31.185 INFO:teuthology.orchestra.run.trial191.stdout:(30/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 777 kB/s | 246 kB 00:00 2026-02-26T02:56:31.328 INFO:teuthology.orchestra.run.trial191.stdout:(31/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.5 MB/s | 3.0 MB 00:01 2026-02-26T02:56:31.345 INFO:teuthology.orchestra.run.trial191.stdout:(32/98): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2026-02-26T02:56:31.488 INFO:teuthology.orchestra.run.trial191.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 263 kB/s | 42 kB 00:00 2026-02-26T02:56:31.594 INFO:teuthology.orchestra.run.trial191.stdout:(34/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 21 MB/s | 5.3 MB 00:00 2026-02-26T02:56:31.730 INFO:teuthology.orchestra.run.trial191.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2026-02-26T02:56:31.789 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-26T02:56:31.808 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-26T02:56:31.822 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-26T02:56:31.838 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-26T02:56:31.846 INFO:teuthology.orchestra.run.trial191.stdout:(36/98): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2026-02-26T02:56:31.891 INFO:teuthology.orchestra.run.trial191.stdout:(37/98): python3-devel-3.9.25-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-26T02:56:31.913 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-26T02:56:31.922 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-26T02:56:31.945 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-26T02:56:31.975 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-26T02:56:32.007 INFO:teuthology.orchestra.run.trial191.stdout:(38/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-26T02:56:32.026 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-26T02:56:32.032 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-26T02:56:32.035 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-26T02:56:32.036 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-26T02:56:32.050 INFO:teuthology.orchestra.run.trial191.stdout:(39/98): python3-libstoragemgmt-1.10.1-1.el9.x8 1.1 MB/s | 177 kB 00:00 2026-02-26T02:56:32.056 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-26T02:56:32.056 INFO:teuthology.orchestra.run.trial190.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-26T02:56:32.056 INFO:teuthology.orchestra.run.trial190.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-26T02:56:32.056 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:32.063 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-26T02:56:32.088 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-26T02:56:32.088 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-26T02:56:32.089 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:32.124 INFO:teuthology.orchestra.run.trial190.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-26T02:56:32.173 INFO:teuthology.orchestra.run.trial191.stdout:(40/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 7.4 MB/s | 1.2 MB 00:00 2026-02-26T02:56:32.188 INFO:teuthology.orchestra.run.trial190.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 83/98 2026-02-26T02:56:32.190 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 84/98 2026-02-26T02:56:32.204 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 84/98 2026-02-26T02:56:32.204 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:32.204 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-26T02:56:32.204 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:32.211 INFO:teuthology.orchestra.run.trial191.stdout:(41/98): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2026-02-26T02:56:32.333 INFO:teuthology.orchestra.run.trial191.stdout:(42/98): python3-markupsafe-1.1.1-12.el9.x86_64 216 kB/s | 35 kB 00:00 2026-02-26T02:56:32.463 INFO:teuthology.orchestra.run.trial191.stdout:(43/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 24 MB/s | 6.1 MB 00:00 2026-02-26T02:56:32.495 INFO:teuthology.orchestra.run.trial191.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.7 MB/s | 442 kB 00:00 2026-02-26T02:56:32.625 INFO:teuthology.orchestra.run.trial191.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 477 kB/s | 77 kB 00:00 2026-02-26T02:56:32.655 INFO:teuthology.orchestra.run.trial191.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 1.6 MB/s | 267 kB 00:00 2026-02-26T02:56:32.786 INFO:teuthology.orchestra.run.trial191.stdout:(47/98): python3-pyasn1-0.4.8-7.el9.noarch.rpm 977 kB/s | 157 kB 00:00 2026-02-26T02:56:32.814 INFO:teuthology.orchestra.run.trial191.stdout:(48/98): python3-pyasn1-modules-0.4.8-7.el9.noa 1.7 MB/s | 277 kB 00:00 2026-02-26T02:56:32.901 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 85/98 2026-02-26T02:56:32.928 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 85/98 2026-02-26T02:56:32.928 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:32.928 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-26T02:56:32.928 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:56:32.928 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:56:32.928 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:32.946 INFO:teuthology.orchestra.run.trial191.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 335 kB/s | 54 kB 00:00 2026-02-26T02:56:32.987 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: cephadm-2:19.2.3-687.g8d724284.el9.noarch 86/98 2026-02-26T02:56:32.989 INFO:teuthology.orchestra.run.trial190.stdout: Installing : cephadm-2:19.2.3-687.g8d724284.el9.noarch 86/98 2026-02-26T02:56:32.993 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 87/98 2026-02-26T02:56:33.013 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 88/98 2026-02-26T02:56:33.015 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 89/98 2026-02-26T02:56:33.107 INFO:teuthology.orchestra.run.trial191.stdout:(50/98): python3-toml-0.10.2-6.el9.noarch.rpm 260 kB/s | 42 kB 00:00 2026-02-26T02:56:33.267 INFO:teuthology.orchestra.run.trial191.stdout:(51/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.2 MB/s | 189 kB 00:00 2026-02-26T02:56:33.390 INFO:teuthology.orchestra.run.trial191.stdout:(52/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 33 MB/s | 19 MB 00:00 2026-02-26T02:56:33.427 INFO:teuthology.orchestra.run.trial191.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 565 kB/s | 90 kB 00:00 2026-02-26T02:56:33.510 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 89/98 2026-02-26T02:56:33.513 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 90/98 2026-02-26T02:56:33.549 INFO:teuthology.orchestra.run.trial191.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2026-02-26T02:56:33.590 INFO:teuthology.orchestra.run.trial191.stdout:(55/98): protobuf-compiler-3.14.0-17.el9.x86_64 5.2 MB/s | 862 kB 00:00 2026-02-26T02:56:33.649 INFO:teuthology.orchestra.run.trial191.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 329 kB/s | 19 kB 00:00 2026-02-26T02:56:33.711 INFO:teuthology.orchestra.run.trial191.stdout:(57/98): luarocks-3.9.2-5.el9.noarch.rpm 2.4 MB/s | 151 kB 00:00 2026-02-26T02:56:33.740 INFO:teuthology.orchestra.run.trial191.stdout:(58/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.8 MB/s | 551 kB 00:00 2026-02-26T02:56:33.763 INFO:teuthology.orchestra.run.trial191.stdout:(59/98): python3-asyncssh-2.13.2-5.el9.noarch.r 10 MB/s | 548 kB 00:00 2026-02-26T02:56:33.770 INFO:teuthology.orchestra.run.trial191.stdout:(60/98): python3-autocommand-2.2.2-8.el9.noarch 980 kB/s | 29 kB 00:00 2026-02-26T02:56:33.787 INFO:teuthology.orchestra.run.trial191.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 2.4 MB/s | 60 kB 00:00 2026-02-26T02:56:33.801 INFO:teuthology.orchestra.run.trial191.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.4 MB/s | 43 kB 00:00 2026-02-26T02:56:33.810 INFO:teuthology.orchestra.run.trial191.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 1.4 MB/s | 32 kB 00:00 2026-02-26T02:56:33.832 INFO:teuthology.orchestra.run.trial191.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 462 kB/s | 14 kB 00:00 2026-02-26T02:56:33.836 INFO:teuthology.orchestra.run.trial191.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 6.7 MB/s | 173 kB 00:00 2026-02-26T02:56:33.866 INFO:teuthology.orchestra.run.trial191.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2026-02-26T02:56:33.867 INFO:teuthology.orchestra.run.trial191.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 8.0 MB/s | 254 kB 00:00 2026-02-26T02:56:33.893 INFO:teuthology.orchestra.run.trial191.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 5.5 MB/s | 144 kB 00:00 2026-02-26T02:56:33.919 INFO:teuthology.orchestra.run.trial191.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 5.2 MB/s | 139 kB 00:00 2026-02-26T02:56:33.939 INFO:teuthology.orchestra.run.trial191.stdout:(70/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 28 MB/s | 2.0 MB 00:00 2026-02-26T02:56:33.943 INFO:teuthology.orchestra.run.trial191.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 2.3 MB/s | 56 kB 00:00 2026-02-26T02:56:33.966 INFO:teuthology.orchestra.run.trial191.stdout:(72/98): python3-jaraco-classes-3.2.1-5.el9.noa 794 kB/s | 18 kB 00:00 2026-02-26T02:56:33.967 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 90/98 2026-02-26T02:56:33.967 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 91/98 2026-02-26T02:56:33.968 INFO:teuthology.orchestra.run.trial191.stdout:(73/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 373 kB/s | 11 kB 00:00 2026-02-26T02:56:33.980 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 91/98 2026-02-26T02:56:33.981 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 92/98 2026-02-26T02:56:33.988 INFO:teuthology.orchestra.run.trial191.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 1.0 MB/s | 23 kB 00:00 2026-02-26T02:56:33.996 INFO:teuthology.orchestra.run.trial191.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 685 kB/s | 20 kB 00:00 2026-02-26T02:56:34.011 INFO:teuthology.orchestra.run.trial191.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 833 kB/s | 19 kB 00:00 2026-02-26T02:56:34.026 INFO:teuthology.orchestra.run.trial191.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 872 kB/s | 26 kB 00:00 2026-02-26T02:56:34.037 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 92/98 2026-02-26T02:56:34.057 INFO:teuthology.orchestra.run.trial191.stdout:(78/98): python3-kubernetes-26.1.0-3.el9.noarch 23 MB/s | 1.0 MB 00:00 2026-02-26T02:56:34.059 INFO:teuthology.orchestra.run.trial191.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2026-02-26T02:56:34.082 INFO:teuthology.orchestra.run.trial191.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2026-02-26T02:56:34.086 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 93/98 2026-02-26T02:56:34.087 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 94/98 2026-02-26T02:56:34.091 INFO:teuthology.orchestra.run.trial191.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.7 MB/s | 86 kB 00:00 2026-02-26T02:56:34.106 INFO:teuthology.orchestra.run.trial191.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2026-02-26T02:56:34.109 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 94/98 2026-02-26T02:56:34.109 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:34.109 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-26T02:56:34.109 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:56:34.109 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:56:34.109 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:34.120 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 95/98 2026-02-26T02:56:34.122 INFO:teuthology.orchestra.run.trial191.stdout:(83/98): python3-pecan-1.4.2-3.el9.noarch.rpm 8.4 MB/s | 272 kB 00:00 2026-02-26T02:56:34.128 INFO:teuthology.orchestra.run.trial191.stdout:(84/98): python3-portend-3.1.0-2.el9.noarch.rpm 738 kB/s | 16 kB 00:00 2026-02-26T02:56:34.150 INFO:teuthology.orchestra.run.trial191.stdout:(85/98): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-26T02:56:34.151 INFO:teuthology.orchestra.run.trial191.stdout:(86/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.1 MB/s | 90 kB 00:00 2026-02-26T02:56:34.180 INFO:teuthology.orchestra.run.trial191.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 6.3 MB/s | 188 kB 00:00 2026-02-26T02:56:34.183 INFO:teuthology.orchestra.run.trial191.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2026-02-26T02:56:34.205 INFO:teuthology.orchestra.run.trial191.stdout:(89/98): python3-saml-1.16.0-1.el9.noarch.rpm 4.8 MB/s | 125 kB 00:00 2026-02-26T02:56:34.214 INFO:teuthology.orchestra.run.trial191.stdout:(90/98): python3-tempora-5.0.0-2.el9.noarch.rpm 1.1 MB/s | 36 kB 00:00 2026-02-26T02:56:34.228 INFO:teuthology.orchestra.run.trial191.stdout:(91/98): python3-typing-extensions-4.15.0-1.el9 3.7 MB/s | 86 kB 00:00 2026-02-26T02:56:34.248 INFO:teuthology.orchestra.run.trial191.stdout:(92/98): python3-webob-1.8.8-2.el9.noarch.rpm 6.6 MB/s | 230 kB 00:00 2026-02-26T02:56:34.252 INFO:teuthology.orchestra.run.trial191.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 3.6 MB/s | 90 kB 00:00 2026-02-26T02:56:34.275 INFO:teuthology.orchestra.run.trial191.stdout:(94/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.0 MB/s | 48 kB 00:00 2026-02-26T02:56:34.284 INFO:teuthology.orchestra.run.trial191.stdout:(95/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 12 MB/s | 427 kB 00:00 2026-02-26T02:56:34.298 INFO:teuthology.orchestra.run.trial191.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 977 kB/s | 22 kB 00:00 2026-02-26T02:56:34.314 INFO:teuthology.orchestra.run.trial191.stdout:(97/98): python3-zc-lockfile-2.0-10.el9.noarch. 668 kB/s | 20 kB 00:00 2026-02-26T02:56:34.337 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 95/98 2026-02-26T02:56:34.338 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 96/98 2026-02-26T02:56:34.359 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 96/98 2026-02-26T02:56:34.359 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:34.359 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-26T02:56:34.359 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:56:34.359 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:56:34.359 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:34.459 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 97/98 2026-02-26T02:56:34.480 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 97/98 2026-02-26T02:56:34.481 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:34.481 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-26T02:56:34.481 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:56:34.481 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:56:34.481 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:34.499 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-2:19.2.3-687.g8d724284.el9.x86_64 98/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-2:19.2.3-687.g8d724284.el9.x86_64 98/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-2:19.2.3-687.g8d724284.el9.x86_64 1/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 3/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 4/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 5/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 6/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 7/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 8/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 9/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 10/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 11/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 12/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 13/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 14/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : cephadm-2:19.2.3-687.g8d724284.el9.noarch 15/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/98 2026-02-26T02:56:35.157 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-26T02:56:35.158 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 38/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-26T02:56:35.161 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 48/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 49/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-26T02:56:35.162 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-26T02:56:35.163 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:56:35.231 INFO:teuthology.orchestra.run.trial190.stdout: lua-5.4.4-4.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-26T02:56:35.232 INFO:teuthology.orchestra.run.trial190.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-ply-3.11-14.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: unzip-6.0-59.el9.x86_64 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: zip-3.0-35.el9.x86_64 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:35.233 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:35.287 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-base 2026-02-26T02:56:35.613 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:35 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:35.678 INFO:teuthology.orchestra.run.trial190.stdout:Package ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:35.696 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:35.698 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:35.698 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:35.719 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install cephadm 2026-02-26T02:56:36.043 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:36 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:36.109 INFO:teuthology.orchestra.run.trial190.stdout:Package cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:36.127 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:36.128 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:36.128 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:36.151 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T02:56:36.459 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:36 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:36.542 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:36.542 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repo Size 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-687.g8d724284.el9 ceph 145 k 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:Install 1 Package 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 145 k 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 431 k 2026-02-26T02:56:36.543 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:36.630 INFO:teuthology.orchestra.run.trial190.stdout:ceph-immutable-object-cache-19.2.3-687.g8d72428 1.6 MB/s | 145 kB 00:00 2026-02-26T02:56:36.630 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:36.631 INFO:teuthology.orchestra.run.trial190.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-26T02:56:36.631 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:36.634 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:36.634 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:36.666 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:36.666 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:36.675 INFO:teuthology.orchestra.run.trial191.stdout:(98/98): zip-3.0-35.el9.x86_64.rpm 38 kB/s | 266 kB 00:06 2026-02-26T02:56:36.680 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:36.680 INFO:teuthology.orchestra.run.trial191.stdout:Total 7.3 MB/s | 95 MB 00:13 2026-02-26T02:56:36.722 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:36.723 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:56:36.745 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:56:36.746 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:36.746 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-26T02:56:36.746 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:37.077 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:56:37.077 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:37.077 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:37.077 INFO:teuthology.orchestra.run.trial190.stdout: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:37.077 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:37.077 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:37.082 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:56:37.104 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-mgr 2026-02-26T02:56:37.119 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:56:37.119 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:56:37.427 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:37 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:37.493 INFO:teuthology.orchestra.run.trial190.stdout:Package ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:37.511 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:37.511 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:37.511 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:37.534 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T02:56:37.537 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:56:37.537 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:56:37.850 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:37 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:37.916 INFO:teuthology.orchestra.run.trial190.stdout:Package ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:37.934 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:37.935 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:37.935 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:37.955 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T02:56:37.988 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:56:37.990 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-26T02:56:38.022 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-26T02:56:38.027 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-26T02:56:38.049 INFO:teuthology.orchestra.run.trial191.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-26T02:56:38.061 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/98 2026-02-26T02:56:38.067 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-26T02:56:38.100 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-26T02:56:38.110 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-26T02:56:38.115 INFO:teuthology.orchestra.run.trial191.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-26T02:56:38.117 INFO:teuthology.orchestra.run.trial191.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-26T02:56:38.122 INFO:teuthology.orchestra.run.trial191.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-26T02:56:38.146 INFO:teuthology.orchestra.run.trial191.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-26T02:56:38.159 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-26T02:56:38.163 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-26T02:56:38.168 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-26T02:56:38.170 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-26T02:56:38.182 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-26T02:56:38.188 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-26T02:56:38.212 INFO:teuthology.orchestra.run.trial191.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-26T02:56:38.215 INFO:teuthology.orchestra.run.trial191.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-26T02:56:38.222 INFO:teuthology.orchestra.run.trial191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-26T02:56:38.247 INFO:teuthology.orchestra.run.trial191.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-26T02:56:38.271 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:38 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:38.300 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-26T02:56:38.314 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 24/98 2026-02-26T02:56:38.316 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-26T02:56:38.321 INFO:teuthology.orchestra.run.trial191.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-26T02:56:38.326 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-26T02:56:38.331 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-26T02:56:38.334 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-26T02:56:38.336 INFO:teuthology.orchestra.run.trial190.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:38.349 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-26T02:56:38.355 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:38.355 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:38.355 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:38.370 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-26T02:56:38.375 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-26T02:56:38.377 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-mgr-rook 2026-02-26T02:56:38.380 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-26T02:56:38.392 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-26T02:56:38.401 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-26T02:56:38.407 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-26T02:56:38.427 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-26T02:56:38.437 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-26T02:56:38.492 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-26T02:56:38.505 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-26T02:56:38.521 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-26T02:56:38.525 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-26T02:56:38.533 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-26T02:56:38.575 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-26T02:56:38.697 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:38 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:38.762 INFO:teuthology.orchestra.run.trial190.stdout:Package ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:38.781 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:38.782 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:38.782 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:38.804 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T02:56:38.911 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-26T02:56:38.921 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-26T02:56:38.925 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-26T02:56:38.931 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-26T02:56:38.933 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-26T02:56:38.961 INFO:teuthology.orchestra.run.trial191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-26T02:56:39.005 INFO:teuthology.orchestra.run.trial191.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-26T02:56:39.012 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-26T02:56:39.015 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-26T02:56:39.021 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-26T02:56:39.025 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-26T02:56:39.032 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-26T02:56:39.036 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-26T02:56:39.064 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-26T02:56:39.074 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-26T02:56:39.109 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-26T02:56:39.125 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:39 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:39.192 INFO:teuthology.orchestra.run.trial190.stdout:Package ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:39.211 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:39.211 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:39.212 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:39.233 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-fuse 2026-02-26T02:56:39.339 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 61/98 2026-02-26T02:56:39.363 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-26T02:56:39.367 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-26T02:56:39.426 INFO:teuthology.orchestra.run.trial191.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-26T02:56:39.428 INFO:teuthology.orchestra.run.trial191.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-26T02:56:39.449 INFO:teuthology.orchestra.run.trial191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-26T02:56:39.555 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:39 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:39.641 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:39.641 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:39.641 INFO:teuthology.orchestra.run.trial190.stdout: Package Architecture Version Repository Size 2026-02-26T02:56:39.641 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout: ceph-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.2 M 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout:Install 1 Package 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 1.2 M 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 3.6 M 2026-02-26T02:56:39.642 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:39.769 INFO:teuthology.orchestra.run.trial190.stdout:ceph-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 9.0 MB/s | 1.2 MB 00:00 2026-02-26T02:56:39.770 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:39.770 INFO:teuthology.orchestra.run.trial190.stdout:Total 8.9 MB/s | 1.2 MB 00:00 2026-02-26T02:56:39.770 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:39.774 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:39.774 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:39.783 INFO:teuthology.orchestra.run.trial191.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-26T02:56:39.810 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:39.810 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:39.858 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-26T02:56:39.912 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:39.931 INFO:teuthology.orchestra.run.trial190.stdout: Installing : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:40.150 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:40.212 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:40.212 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:40.212 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:40.212 INFO:teuthology.orchestra.run.trial190.stdout: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:40.212 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:40.212 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:40.240 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install ceph-volume 2026-02-26T02:56:40.547 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-26T02:56:40.560 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:40 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:40.566 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-26T02:56:40.580 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-26T02:56:40.596 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-26T02:56:40.625 INFO:teuthology.orchestra.run.trial190.stdout:Package ceph-volume-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:40.643 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:40.644 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:40.644 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:40.667 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install librados-devel 2026-02-26T02:56:40.673 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-26T02:56:40.681 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-26T02:56:40.706 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-26T02:56:40.736 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-26T02:56:40.788 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-26T02:56:40.794 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-26T02:56:40.797 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-26T02:56:40.798 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-26T02:56:40.817 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-26T02:56:40.817 INFO:teuthology.orchestra.run.trial191.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-26T02:56:40.817 INFO:teuthology.orchestra.run.trial191.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-26T02:56:40.817 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:40.825 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-26T02:56:40.850 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-26T02:56:40.850 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-26T02:56:40.850 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:40.884 INFO:teuthology.orchestra.run.trial191.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-26T02:56:40.950 INFO:teuthology.orchestra.run.trial191.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 83/98 2026-02-26T02:56:40.952 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 84/98 2026-02-26T02:56:40.965 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 84/98 2026-02-26T02:56:40.965 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:40.965 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-26T02:56:40.965 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:40.980 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:40 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:41.065 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:41.065 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:41.065 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repo Size 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout: librados-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 126 k 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:Install 1 Package 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 126 k 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 456 k 2026-02-26T02:56:41.066 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:41.154 INFO:teuthology.orchestra.run.trial190.stdout:librados-devel-19.2.3-687.g8d724284.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-26T02:56:41.155 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:41.155 INFO:teuthology.orchestra.run.trial190.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-26T02:56:41.155 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:41.157 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:41.157 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:41.189 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:41.189 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:41.245 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:41.262 INFO:teuthology.orchestra.run.trial190.stdout: Installing : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:41.354 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:41.417 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:41.417 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:41.417 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:41.417 INFO:teuthology.orchestra.run.trial190.stdout: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:41.417 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:41.417 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:41.445 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install libcephfs2 2026-02-26T02:56:41.668 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 85/98 2026-02-26T02:56:41.693 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 85/98 2026-02-26T02:56:41.693 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:41.693 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-26T02:56:41.693 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:56:41.693 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:56:41.694 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:41.750 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: cephadm-2:19.2.3-687.g8d724284.el9.noarch 86/98 2026-02-26T02:56:41.752 INFO:teuthology.orchestra.run.trial191.stdout: Installing : cephadm-2:19.2.3-687.g8d724284.el9.noarch 86/98 2026-02-26T02:56:41.757 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 87/98 2026-02-26T02:56:41.777 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:41 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:41.777 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 88/98 2026-02-26T02:56:41.778 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 89/98 2026-02-26T02:56:41.842 INFO:teuthology.orchestra.run.trial190.stdout:Package libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:41.860 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:41.861 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:41.861 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:41.884 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install libcephfs-devel 2026-02-26T02:56:42.209 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:42 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:42.274 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 89/98 2026-02-26T02:56:42.277 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 90/98 2026-02-26T02:56:42.293 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repo Size 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout: libcephfs-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 34 k 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout:Install 1 Package 2026-02-26T02:56:42.294 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:42.295 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 34 k 2026-02-26T02:56:42.295 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 153 k 2026-02-26T02:56:42.295 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:42.357 INFO:teuthology.orchestra.run.trial190.stdout:libcephfs-devel-19.2.3-687.g8d724284.el9.x86_64 525 kB/s | 34 kB 00:00 2026-02-26T02:56:42.358 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:42.358 INFO:teuthology.orchestra.run.trial190.stdout:Total 519 kB/s | 34 kB 00:00 2026-02-26T02:56:42.358 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:42.359 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:42.360 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:42.362 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:42.362 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:42.384 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:42.401 INFO:teuthology.orchestra.run.trial190.stdout: Installing : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:42.466 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:42.529 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:42.529 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:42.529 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:42.529 INFO:teuthology.orchestra.run.trial190.stdout: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:42.529 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:42.529 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:42.558 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install librados2 2026-02-26T02:56:42.732 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 90/98 2026-02-26T02:56:42.732 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 91/98 2026-02-26T02:56:42.744 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 91/98 2026-02-26T02:56:42.745 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 92/98 2026-02-26T02:56:42.801 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 92/98 2026-02-26T02:56:42.851 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 93/98 2026-02-26T02:56:42.852 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 94/98 2026-02-26T02:56:42.874 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 94/98 2026-02-26T02:56:42.874 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:42.875 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-26T02:56:42.875 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:56:42.875 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:56:42.875 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:42.877 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:42 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:42.886 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 95/98 2026-02-26T02:56:42.944 INFO:teuthology.orchestra.run.trial190.stdout:Package librados2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:42.963 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:42.963 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:42.963 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:42.986 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install librbd1 2026-02-26T02:56:43.102 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 95/98 2026-02-26T02:56:43.103 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 96/98 2026-02-26T02:56:43.125 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 96/98 2026-02-26T02:56:43.125 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:43.125 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-26T02:56:43.125 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:56:43.125 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:56:43.125 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:43.228 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 97/98 2026-02-26T02:56:43.249 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 97/98 2026-02-26T02:56:43.250 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:43.250 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-26T02:56:43.250 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:56:43.250 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:56:43.250 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:43.269 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-2:19.2.3-687.g8d724284.el9.x86_64 98/98 2026-02-26T02:56:43.306 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:43 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:43.371 INFO:teuthology.orchestra.run.trial190.stdout:Package librbd1-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:43.390 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:43.390 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:43.390 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:43.412 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install python3-rados 2026-02-26T02:56:43.728 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:43 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:43.793 INFO:teuthology.orchestra.run.trial190.stdout:Package python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:43.812 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:43.813 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:43.813 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:43.834 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install python3-rgw 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-2:19.2.3-687.g8d724284.el9.x86_64 98/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-2:19.2.3-687.g8d724284.el9.x86_64 1/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 3/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 4/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 5/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 6/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 7/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 8/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 9/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 10/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 11/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 12/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 13/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 14/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : cephadm-2:19.2.3-687.g8d724284.el9.noarch 15/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-26T02:56:43.937 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 38/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 48/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 49/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-26T02:56:43.938 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-26T02:56:43.939 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-26T02:56:44.010 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-26T02:56:44.010 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:44.010 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:56:44.010 INFO:teuthology.orchestra.run.trial191.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-26T02:56:44.010 INFO:teuthology.orchestra.run.trial191.stdout: ceph-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:44.010 INFO:teuthology.orchestra.run.trial191.stdout: ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: lua-5.4.4-4.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-26T02:56:44.011 INFO:teuthology.orchestra.run.trial191.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:56:44.012 INFO:teuthology.orchestra.run.trial191.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-ply-3.11-14.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-26T02:56:44.013 INFO:teuthology.orchestra.run.trial191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: unzip-6.0-59.el9.x86_64 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: zip-3.0-35.el9.x86_64 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:44.014 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:44.066 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-base 2026-02-26T02:56:44.149 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:44 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:44.214 INFO:teuthology.orchestra.run.trial190.stdout:Package python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:44.233 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:44.234 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:44.234 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:44.256 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install python3-cephfs 2026-02-26T02:56:44.385 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:43 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:44.450 INFO:teuthology.orchestra.run.trial191.stdout:Package ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:44.469 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:44.469 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:44.470 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:44.490 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install cephadm 2026-02-26T02:56:44.572 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:44 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:44.637 INFO:teuthology.orchestra.run.trial190.stdout:Package python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:44.656 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:44.656 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:44.656 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:44.678 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install python3-rbd 2026-02-26T02:56:44.806 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:43 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:44.871 INFO:teuthology.orchestra.run.trial191.stdout:Package cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:44.889 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:44.889 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:44.889 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:44.910 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T02:56:44.992 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:44 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:45.057 INFO:teuthology.orchestra.run.trial190.stdout:Package python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:45.076 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:45.077 INFO:teuthology.orchestra.run.trial190.stdout:Nothing to do. 2026-02-26T02:56:45.077 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:45.099 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install rbd-fuse 2026-02-26T02:56:45.225 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:44 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:45.310 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:45.310 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:45.310 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repo Size 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-687.g8d724284.el9 ceph 145 k 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:Install 1 Package 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 145 k 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 431 k 2026-02-26T02:56:45.311 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:56:45.418 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:45 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:45.502 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout: Package Architecture Version Repository Size 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout: rbd-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 85 k 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:Install 1 Package 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 85 k 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 227 k 2026-02-26T02:56:45.503 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:45.763 INFO:teuthology.orchestra.run.trial191.stdout:ceph-immutable-object-cache-19.2.3-687.g8d72428 321 kB/s | 145 kB 00:00 2026-02-26T02:56:45.764 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:45.764 INFO:teuthology.orchestra.run.trial191.stdout:Total 320 kB/s | 145 kB 00:00 2026-02-26T02:56:45.764 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:56:45.768 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:56:45.768 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:56:45.799 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:56:45.800 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:56:45.855 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:56:45.856 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:56:45.879 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:56:45.879 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:45.879 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-26T02:56:45.879 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:45.880 INFO:teuthology.orchestra.run.trial190.stdout:rbd-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 226 kB/s | 85 kB 00:00 2026-02-26T02:56:45.880 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:45.881 INFO:teuthology.orchestra.run.trial190.stdout:Total 225 kB/s | 85 kB 00:00 2026-02-26T02:56:45.881 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:45.884 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:45.884 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:45.916 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:45.917 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:45.968 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:45.986 INFO:teuthology.orchestra.run.trial190.stdout: Installing : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:46.069 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:46.134 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:46.134 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:46.134 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:46.134 INFO:teuthology.orchestra.run.trial190.stdout: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:46.134 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:46.134 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:46.162 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install rbd-mirror 2026-02-26T02:56:46.173 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:56:46.173 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:46.173 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:56:46.173 INFO:teuthology.orchestra.run.trial191.stdout: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:46.173 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:46.173 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:46.200 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-mgr 2026-02-26T02:56:46.480 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:46 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:46.521 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:45 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:46.564 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:46.564 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:46.564 INFO:teuthology.orchestra.run.trial190.stdout: Package Arch Version Repo Size 2026-02-26T02:56:46.564 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:46.564 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout: rbd-mirror x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.1 M 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout:Install 1 Package 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 3.1 M 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 13 M 2026-02-26T02:56:46.565 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:46.586 INFO:teuthology.orchestra.run.trial191.stdout:Package ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:46.604 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:46.605 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:46.605 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:46.626 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T02:56:46.945 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:45 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:47.012 INFO:teuthology.orchestra.run.trial191.stdout:Package ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:47.031 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:47.032 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:47.032 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:47.053 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T02:56:47.369 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:46 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:47.434 INFO:teuthology.orchestra.run.trial191.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:47.452 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:47.453 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:47.453 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:47.475 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-mgr-rook 2026-02-26T02:56:47.575 INFO:teuthology.orchestra.run.trial190.stdout:rbd-mirror-19.2.3-687.g8d724284.el9.x86_64.rpm 3.1 MB/s | 3.1 MB 00:01 2026-02-26T02:56:47.575 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:47.575 INFO:teuthology.orchestra.run.trial190.stdout:Total 3.1 MB/s | 3.1 MB 00:01 2026-02-26T02:56:47.575 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:47.580 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:47.580 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:47.620 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:47.620 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:47.789 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:46 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:47.814 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:47.815 INFO:teuthology.orchestra.run.trial190.stdout: Installing : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:47.839 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:47.839 INFO:teuthology.orchestra.run.trial190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:56:47.839 INFO:teuthology.orchestra.run.trial190.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-26T02:56:47.839 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:56:47.839 INFO:teuthology.orchestra.run.trial190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:56:47.839 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:47.854 INFO:teuthology.orchestra.run.trial191.stdout:Package ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:47.872 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:47.873 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:47.873 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:47.895 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T02:56:48.156 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:48.156 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:48.156 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:48.157 INFO:teuthology.orchestra.run.trial190.stdout: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:48.157 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:48.157 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:48.185 DEBUG:teuthology.orchestra.run.trial190:> sudo yum -y install rbd-nbd 2026-02-26T02:56:48.208 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:47 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:48.273 INFO:teuthology.orchestra.run.trial191.stdout:Package ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:48.291 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:48.292 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:48.292 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:48.313 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-fuse 2026-02-26T02:56:48.511 INFO:teuthology.orchestra.run.trial190.stdout:Last metadata expiration check: 0:00:48 ago on Thu 26 Feb 2026 02:56:00 AM UTC. 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout:Dependencies resolved. 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout: Package Architecture Version Repository Size 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout:Installing: 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout: rbd-nbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 170 k 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout:Transaction Summary 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout:================================================================================ 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout:Install 1 Package 2026-02-26T02:56:48.594 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:48.595 INFO:teuthology.orchestra.run.trial190.stdout:Total download size: 170 k 2026-02-26T02:56:48.595 INFO:teuthology.orchestra.run.trial190.stdout:Installed size: 490 k 2026-02-26T02:56:48.595 INFO:teuthology.orchestra.run.trial190.stdout:Downloading Packages: 2026-02-26T02:56:48.630 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:47 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:48.715 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:48.716 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout: Package Architecture Version Repository Size 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout: ceph-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.2 M 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:48.717 INFO:teuthology.orchestra.run.trial191.stdout:Install 1 Package 2026-02-26T02:56:48.718 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:48.718 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 1.2 M 2026-02-26T02:56:48.718 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 3.6 M 2026-02-26T02:56:48.718 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:56:49.040 INFO:teuthology.orchestra.run.trial190.stdout:rbd-nbd-19.2.3-687.g8d724284.el9.x86_64.rpm 383 kB/s | 170 kB 00:00 2026-02-26T02:56:49.041 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:49.041 INFO:teuthology.orchestra.run.trial190.stdout:Total 382 kB/s | 170 kB 00:00 2026-02-26T02:56:49.042 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction check 2026-02-26T02:56:49.046 INFO:teuthology.orchestra.run.trial190.stdout:Transaction check succeeded. 2026-02-26T02:56:49.046 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction test 2026-02-26T02:56:49.079 INFO:teuthology.orchestra.run.trial190.stdout:Transaction test succeeded. 2026-02-26T02:56:49.079 INFO:teuthology.orchestra.run.trial190.stdout:Running transaction 2026-02-26T02:56:49.135 INFO:teuthology.orchestra.run.trial190.stdout: Preparing : 1/1 2026-02-26T02:56:49.155 INFO:teuthology.orchestra.run.trial190.stdout: Installing : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:49.244 INFO:teuthology.orchestra.run.trial190.stdout: Running scriptlet: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:49.307 INFO:teuthology.orchestra.run.trial190.stdout: Verifying : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:49.307 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:49.307 INFO:teuthology.orchestra.run.trial190.stdout:Installed: 2026-02-26T02:56:49.307 INFO:teuthology.orchestra.run.trial190.stdout: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:49.307 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:56:49.307 INFO:teuthology.orchestra.run.trial190.stdout:Complete! 2026-02-26T02:56:49.339 DEBUG:teuthology.parallel:result is None 2026-02-26T02:56:51.561 INFO:teuthology.orchestra.run.trial191.stdout:ceph-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 415 kB/s | 1.2 MB 00:02 2026-02-26T02:56:51.561 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:51.561 INFO:teuthology.orchestra.run.trial191.stdout:Total 415 kB/s | 1.2 MB 00:02 2026-02-26T02:56:51.561 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:56:51.564 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:56:51.564 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:56:51.599 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:56:51.599 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:56:51.701 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:56:51.719 INFO:teuthology.orchestra.run.trial191.stdout: Installing : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:51.954 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:52.015 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:52.015 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:52.015 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:56:52.015 INFO:teuthology.orchestra.run.trial191.stdout: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:52.015 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:52.016 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:52.042 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install ceph-volume 2026-02-26T02:56:52.358 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:51 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:52.423 INFO:teuthology.orchestra.run.trial191.stdout:Package ceph-volume-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:56:52.442 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:52.443 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:52.443 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:52.464 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install librados-devel 2026-02-26T02:56:52.777 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:51 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:52.860 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repo Size 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout: librados-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 126 k 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:Install 1 Package 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 126 k 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 456 k 2026-02-26T02:56:52.861 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:56:53.337 INFO:teuthology.orchestra.run.trial191.stdout:librados-devel-19.2.3-687.g8d724284.el9.x86_64. 266 kB/s | 126 kB 00:00 2026-02-26T02:56:53.338 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:53.338 INFO:teuthology.orchestra.run.trial191.stdout:Total 265 kB/s | 126 kB 00:00 2026-02-26T02:56:53.338 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:56:53.340 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:56:53.341 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:56:53.373 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:56:53.373 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:56:53.429 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:56:53.446 INFO:teuthology.orchestra.run.trial191.stdout: Installing : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:53.532 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:53.595 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:53.595 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:53.595 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:56:53.595 INFO:teuthology.orchestra.run.trial191.stdout: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:53.595 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:53.595 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:53.625 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install libcephfs2 2026-02-26T02:56:53.946 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:54.011 INFO:teuthology.orchestra.run.trial191.stdout:Package libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:54.030 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:54.030 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:54.030 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:54.053 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install libcephfs-devel 2026-02-26T02:56:54.367 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:54.451 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repo Size 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout: libcephfs-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 34 k 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:54.452 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:54.453 INFO:teuthology.orchestra.run.trial191.stdout:Install 1 Package 2026-02-26T02:56:54.453 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:54.453 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 34 k 2026-02-26T02:56:54.453 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 153 k 2026-02-26T02:56:54.453 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:56:54.760 INFO:teuthology.orchestra.run.trial191.stdout:libcephfs-devel-19.2.3-687.g8d724284.el9.x86_64 109 kB/s | 34 kB 00:00 2026-02-26T02:56:54.760 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:56:54.761 INFO:teuthology.orchestra.run.trial191.stdout:Total 108 kB/s | 34 kB 00:00 2026-02-26T02:56:54.761 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:56:54.763 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:56:54.763 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:56:54.766 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:56:54.766 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:56:54.788 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:56:54.805 INFO:teuthology.orchestra.run.trial191.stdout: Installing : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:54.872 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:54.934 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:56:54.934 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:54.935 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:56:54.935 INFO:teuthology.orchestra.run.trial191.stdout: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:56:54.935 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:54.935 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:54.961 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install librados2 2026-02-26T02:56:55.275 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:54 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:55.341 INFO:teuthology.orchestra.run.trial191.stdout:Package librados2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:55.360 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:55.360 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:55.360 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:55.382 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install librbd1 2026-02-26T02:56:55.697 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:54 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:55.767 INFO:teuthology.orchestra.run.trial191.stdout:Package librbd1-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:55.785 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:55.785 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:55.785 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:55.807 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install python3-rados 2026-02-26T02:56:56.125 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:56.191 INFO:teuthology.orchestra.run.trial191.stdout:Package python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:56.209 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:56.210 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:56.210 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:56.231 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install python3-rgw 2026-02-26T02:56:56.551 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:56.618 INFO:teuthology.orchestra.run.trial191.stdout:Package python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:56.637 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:56.637 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:56.637 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:56.659 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install python3-cephfs 2026-02-26T02:56:56.976 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:57.042 INFO:teuthology.orchestra.run.trial191.stdout:Package python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:57.060 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:57.061 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:57.061 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:57.083 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install python3-rbd 2026-02-26T02:56:57.398 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:57.465 INFO:teuthology.orchestra.run.trial191.stdout:Package python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:56:57.483 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:57.484 INFO:teuthology.orchestra.run.trial191.stdout:Nothing to do. 2026-02-26T02:56:57.484 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:56:57.505 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install rbd-fuse 2026-02-26T02:56:57.821 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:56:57.904 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:56:57.905 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:57.905 INFO:teuthology.orchestra.run.trial191.stdout: Package Architecture Version Repository Size 2026-02-26T02:56:57.905 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:57.905 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:56:57.905 INFO:teuthology.orchestra.run.trial191.stdout: rbd-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 85 k 2026-02-26T02:56:57.905 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:57.906 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:56:57.906 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:56:57.906 INFO:teuthology.orchestra.run.trial191.stdout:Install 1 Package 2026-02-26T02:56:57.906 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:56:57.906 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 85 k 2026-02-26T02:56:57.906 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 227 k 2026-02-26T02:56:57.906 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:57:04.260 INFO:teuthology.orchestra.run.trial191.stdout:rbd-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 13 kB/s | 85 kB 00:06 2026-02-26T02:57:04.260 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:57:04.260 INFO:teuthology.orchestra.run.trial191.stdout:Total 13 kB/s | 85 kB 00:06 2026-02-26T02:57:04.260 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:57:04.264 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:57:04.264 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:57:04.295 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:57:04.295 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:57:04.348 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:57:04.366 INFO:teuthology.orchestra.run.trial191.stdout: Installing : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:04.452 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:04.514 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:04.514 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:04.514 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:57:04.514 INFO:teuthology.orchestra.run.trial191.stdout: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:57:04.514 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:04.514 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:57:04.542 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install rbd-mirror 2026-02-26T02:57:04.861 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:01:03 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:57:04.944 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout: Package Arch Version Repo Size 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout: rbd-mirror x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.1 M 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:Install 1 Package 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 3.1 M 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 13 M 2026-02-26T02:57:04.945 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:57:07.137 INFO:teuthology.orchestra.run.trial191.stdout:rbd-mirror-19.2.3-687.g8d724284.el9.x86_64.rpm 1.4 MB/s | 3.1 MB 00:02 2026-02-26T02:57:07.137 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:57:07.137 INFO:teuthology.orchestra.run.trial191.stdout:Total 1.4 MB/s | 3.1 MB 00:02 2026-02-26T02:57:07.137 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:57:07.141 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:57:07.142 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:57:07.181 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:57:07.181 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:57:07.374 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:57:07.375 INFO:teuthology.orchestra.run.trial191.stdout: Installing : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:07.398 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:07.399 INFO:teuthology.orchestra.run.trial191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:57:07.399 INFO:teuthology.orchestra.run.trial191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-26T02:57:07.399 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:57:07.399 INFO:teuthology.orchestra.run.trial191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:57:07.399 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:07.728 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:07.728 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:07.728 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:57:07.728 INFO:teuthology.orchestra.run.trial191.stdout: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:57:07.728 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:07.728 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:57:07.755 DEBUG:teuthology.orchestra.run.trial191:> sudo yum -y install rbd-nbd 2026-02-26T02:57:08.072 INFO:teuthology.orchestra.run.trial191.stdout:Last metadata expiration check: 0:01:07 ago on Thu 26 Feb 2026 02:56:01 AM UTC. 2026-02-26T02:57:08.156 INFO:teuthology.orchestra.run.trial191.stdout:Dependencies resolved. 2026-02-26T02:57:08.156 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:57:08.156 INFO:teuthology.orchestra.run.trial191.stdout: Package Architecture Version Repository Size 2026-02-26T02:57:08.156 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:57:08.156 INFO:teuthology.orchestra.run.trial191.stdout:Installing: 2026-02-26T02:57:08.156 INFO:teuthology.orchestra.run.trial191.stdout: rbd-nbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 170 k 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout:Transaction Summary 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout:================================================================================ 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout:Install 1 Package 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout:Total download size: 170 k 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout:Installed size: 490 k 2026-02-26T02:57:08.157 INFO:teuthology.orchestra.run.trial191.stdout:Downloading Packages: 2026-02-26T02:57:08.508 INFO:teuthology.orchestra.run.trial191.stdout:rbd-nbd-19.2.3-687.g8d724284.el9.x86_64.rpm 487 kB/s | 170 kB 00:00 2026-02-26T02:57:08.508 INFO:teuthology.orchestra.run.trial191.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:57:08.508 INFO:teuthology.orchestra.run.trial191.stdout:Total 486 kB/s | 170 kB 00:00 2026-02-26T02:57:08.508 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction check 2026-02-26T02:57:08.511 INFO:teuthology.orchestra.run.trial191.stdout:Transaction check succeeded. 2026-02-26T02:57:08.512 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction test 2026-02-26T02:57:08.543 INFO:teuthology.orchestra.run.trial191.stdout:Transaction test succeeded. 2026-02-26T02:57:08.543 INFO:teuthology.orchestra.run.trial191.stdout:Running transaction 2026-02-26T02:57:08.599 INFO:teuthology.orchestra.run.trial191.stdout: Preparing : 1/1 2026-02-26T02:57:08.618 INFO:teuthology.orchestra.run.trial191.stdout: Installing : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:08.700 INFO:teuthology.orchestra.run.trial191.stdout: Running scriptlet: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:08.763 INFO:teuthology.orchestra.run.trial191.stdout: Verifying : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:57:08.763 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:08.763 INFO:teuthology.orchestra.run.trial191.stdout:Installed: 2026-02-26T02:57:08.763 INFO:teuthology.orchestra.run.trial191.stdout: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:57:08.763 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:08.764 INFO:teuthology.orchestra.run.trial191.stdout:Complete! 2026-02-26T02:57:08.793 DEBUG:teuthology.parallel:result is None 2026-02-26T02:57:08.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:57:08.916 DEBUG:teuthology.orchestra.run.trial190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T02:57:08.937 INFO:teuthology.orchestra.run.trial190.stdout:19.2.3-687.g8d724284.el9 2026-02-26T02:57:08.938 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-687.g8d724284.el9 2026-02-26T02:57:08.938 INFO:teuthology.task.install:The correct ceph version 19.2.3-687.g8d724284 is installed. 2026-02-26T02:57:08.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:57:09.078 DEBUG:teuthology.orchestra.run.trial191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T02:57:09.099 INFO:teuthology.orchestra.run.trial191.stdout:19.2.3-687.g8d724284.el9 2026-02-26T02:57:09.100 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-687.g8d724284.el9 2026-02-26T02:57:09.100 INFO:teuthology.task.install:The correct ceph version 19.2.3-687.g8d724284 is installed. 2026-02-26T02:57:09.101 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-26T02:57:09.101 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:09.101 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-26T02:57:09.128 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:57:09.128 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-26T02:57:09.164 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-26T02:57:09.164 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:09.164 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/usr/bin/daemon-helper 2026-02-26T02:57:09.193 DEBUG:teuthology.orchestra.run.trial190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-26T02:57:09.257 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:57:09.257 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/usr/bin/daemon-helper 2026-02-26T02:57:09.282 DEBUG:teuthology.orchestra.run.trial191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-26T02:57:09.346 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-26T02:57:09.346 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:09.346 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-26T02:57:09.371 DEBUG:teuthology.orchestra.run.trial190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-26T02:57:09.435 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:57:09.435 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-26T02:57:09.459 DEBUG:teuthology.orchestra.run.trial191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-26T02:57:09.521 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-26T02:57:09.522 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:09.522 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/usr/bin/stdin-killer 2026-02-26T02:57:09.547 DEBUG:teuthology.orchestra.run.trial190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-26T02:57:09.610 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:57:09.610 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/usr/bin/stdin-killer 2026-02-26T02:57:09.636 DEBUG:teuthology.orchestra.run.trial191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-26T02:57:09.700 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-26T02:57:09.824 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-only-match': ['CEPHADM_'], 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'use-ca-signed-key': True} 2026-02-26T02:57:09.824 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:57:09.825 INFO:tasks.cephadm:Cluster fsid is d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:09.825 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-26T02:57:09.825 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.190', 'mon.b': '10.20.193.191'} 2026-02-26T02:57:09.826 INFO:tasks.cephadm:First mon is mon.a on trial190 2026-02-26T02:57:09.826 INFO:tasks.cephadm:First mgr is a 2026-02-26T02:57:09.826 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-26T02:57:09.826 DEBUG:teuthology.orchestra.run.trial190:> sudo hostname $(hostname -s) 2026-02-26T02:57:09.852 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname $(hostname -s) 2026-02-26T02:57:09.875 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-26T02:57:09.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:57:09.994 INFO:tasks.cephadm:builder_project result: [{'url': 'https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/', 'ref': 'wip-yuri9-testing-2026-02-25-1600-squid', 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-25 23:31:47.079262', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-687-g8d724284', 'package_manager_version': '19.2.3-687.g8d724284', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3278/', 'root_build_cause': '', 'node_name': '10.20.192.98+toko08', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-26T02:57:10.112 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-yuri9-testing-2026-02-25-1600-squid, sha1 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:57:10.113 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/x86_64/flavors/default/cephadm 2026-02-26T02:57:10.113 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/x86_64/flavors/default/cephadm 2026-02-26T02:57:10.114 DEBUG:teuthology.orchestra.run.trial190:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-26T02:57:10.460 INFO:teuthology.orchestra.run.trial190.stdout:-rw-r--r--. 1 ubuntu ubuntu 788311 Feb 26 02:57 /home/ubuntu/cephtest/cephadm 2026-02-26T02:57:10.460 DEBUG:teuthology.orchestra.run.trial191:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-26T02:57:10.826 INFO:teuthology.orchestra.run.trial191.stdout:-rw-r--r--. 1 ubuntu ubuntu 788311 Feb 26 02:57 /home/ubuntu/cephtest/cephadm 2026-02-26T02:57:10.826 DEBUG:teuthology.orchestra.run.trial190:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-26T02:57:10.844 DEBUG:teuthology.orchestra.run.trial191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-26T02:57:10.870 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 on all hosts... 2026-02-26T02:57:10.870 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 pull 2026-02-26T02:57:10.886 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 pull 2026-02-26T02:57:11.030 INFO:teuthology.orchestra.run.trial190.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5... 2026-02-26T02:57:11.050 INFO:teuthology.orchestra.run.trial191.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5... 2026-02-26T02:57:19.987 INFO:teuthology.orchestra.run.trial190.stdout:{ 2026-02-26T02:57:19.987 INFO:teuthology.orchestra.run.trial190.stdout: "ceph_version": "ceph version 19.2.3-687-g8d724284 (8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5) squid (stable)", 2026-02-26T02:57:19.987 INFO:teuthology.orchestra.run.trial190.stdout: "image_id": "d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae", 2026-02-26T02:57:19.987 INFO:teuthology.orchestra.run.trial190.stdout: "repo_digests": [ 2026-02-26T02:57:19.987 INFO:teuthology.orchestra.run.trial190.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644" 2026-02-26T02:57:19.987 INFO:teuthology.orchestra.run.trial190.stdout: ] 2026-02-26T02:57:19.987 INFO:teuthology.orchestra.run.trial190.stdout:} 2026-02-26T02:57:20.005 INFO:teuthology.orchestra.run.trial191.stdout:{ 2026-02-26T02:57:20.005 INFO:teuthology.orchestra.run.trial191.stdout: "ceph_version": "ceph version 19.2.3-687-g8d724284 (8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5) squid (stable)", 2026-02-26T02:57:20.005 INFO:teuthology.orchestra.run.trial191.stdout: "image_id": "d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae", 2026-02-26T02:57:20.006 INFO:teuthology.orchestra.run.trial191.stdout: "repo_digests": [ 2026-02-26T02:57:20.006 INFO:teuthology.orchestra.run.trial191.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644" 2026-02-26T02:57:20.006 INFO:teuthology.orchestra.run.trial191.stdout: ] 2026-02-26T02:57:20.006 INFO:teuthology.orchestra.run.trial191.stdout:} 2026-02-26T02:57:20.022 DEBUG:teuthology.orchestra.run.trial190:> sudo ssh-keygen -t rsa -f /root/ca-key -N '' 2026-02-26T02:57:20.241 INFO:teuthology.orchestra.run.trial190.stdout:Generating public/private rsa key pair. 2026-02-26T02:57:20.241 INFO:teuthology.orchestra.run.trial190.stdout:Your identification has been saved in /root/ca-key 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:Your public key has been saved in /root/ca-key.pub 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:The key fingerprint is: 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:SHA256:/ZLZWbouG3XisI9E9tLkcxbYviczqrq5Whb9IjABUlM root@trial190 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:The key's randomart image is: 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:+---[RSA 3072]----+ 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| ..+.E | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| . o | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| . | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| . o o | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| o S * = = | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| o + / B . | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| + X % + | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| o +.B =+..| 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:| ..=++==..= | 2026-02-26T02:57:20.242 INFO:teuthology.orchestra.run.trial190.stdout:+----[SHA256]-----+ 2026-02-26T02:57:20.243 DEBUG:teuthology.orchestra.run.trial190:> sudo cat /root/ca-key.pub 2026-02-26T02:57:20.265 INFO:teuthology.orchestra.run.trial190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCer59q7TMYySpKbVTzmTXEtRdqf6YI6ekxuh/spapFO3ORQyo0lW1I5zVzPwaPjucSGdHAX7x7xP8T/TiQYva6CqTvFq+jwxHhO7HYCq7YviMMtUqS3g/6PYG3yx+vsUAvLsXRBD+/Az8+3mB5+dSIXY4RPrMfdj/3fLube06vovZolXra+RucOhMK5rqqY2ln2Kv4SEHOh5rVH5nhpeSEDdvN/oIVwC1th25WrB4Y495+DDv1GX6VUOCfsCMbSGwpj5QqrtqVVfxFc60r4DS1ZnWkqlxztxd+CGXTTBCJLPG+53eAqYZF6KmXJMcWouKgU2vyMSJ7nz4FD93TpHJrdUZCZ3yMLe3JC9jz9RRLZTcWj6PvbzmMqlarKQVzp+VYOU2HkOTelkaNjhuv0CeOUnf3kkwyl47TDnUIX29XxB93dlSnOU8a0uLV4OGMBTN1DfZV9NIyiXqyp23KI3U0e20CAJyJIHPLwW4OLcaJxqIgtklVSagGzJ508yRM5EU= root@trial190 2026-02-26T02:57:20.266 DEBUG:teuthology.orchestra.run.trial190:> sudo echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCer59q7TMYySpKbVTzmTXEtRdqf6YI6ekxuh/spapFO3ORQyo0lW1I5zVzPwaPjucSGdHAX7x7xP8T/TiQYva6CqTvFq+jwxHhO7HYCq7YviMMtUqS3g/6PYG3yx+vsUAvLsXRBD+/Az8+3mB5+dSIXY4RPrMfdj/3fLube06vovZolXra+RucOhMK5rqqY2ln2Kv4SEHOh5rVH5nhpeSEDdvN/oIVwC1th25WrB4Y495+DDv1GX6VUOCfsCMbSGwpj5QqrtqVVfxFc60r4DS1ZnWkqlxztxd+CGXTTBCJLPG+53eAqYZF6KmXJMcWouKgU2vyMSJ7nz4FD93TpHJrdUZCZ3yMLe3JC9jz9RRLZTcWj6PvbzmMqlarKQVzp+VYOU2HkOTelkaNjhuv0CeOUnf3kkwyl47TDnUIX29XxB93dlSnOU8a0uLV4OGMBTN1DfZV9NIyiXqyp23KI3U0e20CAJyJIHPLwW4OLcaJxqIgtklVSagGzJ508yRM5EU= root@trial190 2026-02-26T02:57:20.266 DEBUG:teuthology.orchestra.run.trial190:> ' | sudo tee -a /etc/ssh/ca-key.pub 2026-02-26T02:57:20.329 INFO:teuthology.orchestra.run.trial190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCer59q7TMYySpKbVTzmTXEtRdqf6YI6ekxuh/spapFO3ORQyo0lW1I5zVzPwaPjucSGdHAX7x7xP8T/TiQYva6CqTvFq+jwxHhO7HYCq7YviMMtUqS3g/6PYG3yx+vsUAvLsXRBD+/Az8+3mB5+dSIXY4RPrMfdj/3fLube06vovZolXra+RucOhMK5rqqY2ln2Kv4SEHOh5rVH5nhpeSEDdvN/oIVwC1th25WrB4Y495+DDv1GX6VUOCfsCMbSGwpj5QqrtqVVfxFc60r4DS1ZnWkqlxztxd+CGXTTBCJLPG+53eAqYZF6KmXJMcWouKgU2vyMSJ7nz4FD93TpHJrdUZCZ3yMLe3JC9jz9RRLZTcWj6PvbzmMqlarKQVzp+VYOU2HkOTelkaNjhuv0CeOUnf3kkwyl47TDnUIX29XxB93dlSnOU8a0uLV4OGMBTN1DfZV9NIyiXqyp23KI3U0e20CAJyJIHPLwW4OLcaJxqIgtklVSagGzJ508yRM5EU= root@trial190 2026-02-26T02:57:20.329 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:20.332 DEBUG:teuthology.orchestra.run.trial190:> sudo echo 'TrustedUserCAKeys /etc/ssh/ca-key.pub' | sudo tee -a /etc/ssh/sshd_config && sudo systemctl restart sshd 2026-02-26T02:57:20.394 INFO:teuthology.orchestra.run.trial190.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-02-26T02:57:20.428 DEBUG:teuthology.orchestra.run.trial191:> sudo echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCer59q7TMYySpKbVTzmTXEtRdqf6YI6ekxuh/spapFO3ORQyo0lW1I5zVzPwaPjucSGdHAX7x7xP8T/TiQYva6CqTvFq+jwxHhO7HYCq7YviMMtUqS3g/6PYG3yx+vsUAvLsXRBD+/Az8+3mB5+dSIXY4RPrMfdj/3fLube06vovZolXra+RucOhMK5rqqY2ln2Kv4SEHOh5rVH5nhpeSEDdvN/oIVwC1th25WrB4Y495+DDv1GX6VUOCfsCMbSGwpj5QqrtqVVfxFc60r4DS1ZnWkqlxztxd+CGXTTBCJLPG+53eAqYZF6KmXJMcWouKgU2vyMSJ7nz4FD93TpHJrdUZCZ3yMLe3JC9jz9RRLZTcWj6PvbzmMqlarKQVzp+VYOU2HkOTelkaNjhuv0CeOUnf3kkwyl47TDnUIX29XxB93dlSnOU8a0uLV4OGMBTN1DfZV9NIyiXqyp23KI3U0e20CAJyJIHPLwW4OLcaJxqIgtklVSagGzJ508yRM5EU= root@trial190 2026-02-26T02:57:20.428 DEBUG:teuthology.orchestra.run.trial191:> ' | sudo tee -a /etc/ssh/ca-key.pub 2026-02-26T02:57:20.456 INFO:teuthology.orchestra.run.trial191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCer59q7TMYySpKbVTzmTXEtRdqf6YI6ekxuh/spapFO3ORQyo0lW1I5zVzPwaPjucSGdHAX7x7xP8T/TiQYva6CqTvFq+jwxHhO7HYCq7YviMMtUqS3g/6PYG3yx+vsUAvLsXRBD+/Az8+3mB5+dSIXY4RPrMfdj/3fLube06vovZolXra+RucOhMK5rqqY2ln2Kv4SEHOh5rVH5nhpeSEDdvN/oIVwC1th25WrB4Y495+DDv1GX6VUOCfsCMbSGwpj5QqrtqVVfxFc60r4DS1ZnWkqlxztxd+CGXTTBCJLPG+53eAqYZF6KmXJMcWouKgU2vyMSJ7nz4FD93TpHJrdUZCZ3yMLe3JC9jz9RRLZTcWj6PvbzmMqlarKQVzp+VYOU2HkOTelkaNjhuv0CeOUnf3kkwyl47TDnUIX29XxB93dlSnOU8a0uLV4OGMBTN1DfZV9NIyiXqyp23KI3U0e20CAJyJIHPLwW4OLcaJxqIgtklVSagGzJ508yRM5EU= root@trial190 2026-02-26T02:57:20.457 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:20.459 DEBUG:teuthology.orchestra.run.trial191:> sudo echo 'TrustedUserCAKeys /etc/ssh/ca-key.pub' | sudo tee -a /etc/ssh/sshd_config && sudo systemctl restart sshd 2026-02-26T02:57:20.522 INFO:teuthology.orchestra.run.trial191.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-02-26T02:57:20.559 DEBUG:teuthology.orchestra.run.trial190:> sudo ssh-keygen -t rsa -f /root/cephadm-ssh-key -N '' && sudo ssh-keygen -s /root/ca-key -I user_root -n root -V +52w /root/cephadm-ssh-key 2026-02-26T02:57:20.618 INFO:teuthology.orchestra.run.trial190.stdout:Generating public/private rsa key pair. 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:Your identification has been saved in /root/cephadm-ssh-key 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:Your public key has been saved in /root/cephadm-ssh-key.pub 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:The key fingerprint is: 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:SHA256:aDRg9hwKHVh9/RVP3RVL+EE3vC8k06lHb84WAB3hWe8 root@trial190 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:The key's randomart image is: 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:+---[RSA 3072]----+ 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| .+*o. . .oBBO| 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| .+.=... ...o==B| 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| . =. ..=.o=| 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| . o +.=+ | 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| o S *..E| 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| . . o.+| 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| . =.| 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| +| 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:| . | 2026-02-26T02:57:20.619 INFO:teuthology.orchestra.run.trial190.stdout:+----[SHA256]-----+ 2026-02-26T02:57:20.631 INFO:teuthology.orchestra.run.trial190.stderr:Signed user key /root/cephadm-ssh-key-cert.pub: id "user_root" serial 0 for root valid from 2026-02-26T02:56:00 to 2027-02-25T02:57:20 2026-02-26T02:57:20.633 DEBUG:teuthology.orchestra.run.trial190:> sudo cat /etc/ssh/ca-key.pub 2026-02-26T02:57:20.654 INFO:teuthology.orchestra.run.trial190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCer59q7TMYySpKbVTzmTXEtRdqf6YI6ekxuh/spapFO3ORQyo0lW1I5zVzPwaPjucSGdHAX7x7xP8T/TiQYva6CqTvFq+jwxHhO7HYCq7YviMMtUqS3g/6PYG3yx+vsUAvLsXRBD+/Az8+3mB5+dSIXY4RPrMfdj/3fLube06vovZolXra+RucOhMK5rqqY2ln2Kv4SEHOh5rVH5nhpeSEDdvN/oIVwC1th25WrB4Y495+DDv1GX6VUOCfsCMbSGwpj5QqrtqVVfxFc60r4DS1ZnWkqlxztxd+CGXTTBCJLPG+53eAqYZF6KmXJMcWouKgU2vyMSJ7nz4FD93TpHJrdUZCZ3yMLe3JC9jz9RRLZTcWj6PvbzmMqlarKQVzp+VYOU2HkOTelkaNjhuv0CeOUnf3kkwyl47TDnUIX29XxB93dlSnOU8a0uLV4OGMBTN1DfZV9NIyiXqyp23KI3U0e20CAJyJIHPLwW4OLcaJxqIgtklVSagGzJ508yRM5EU= root@trial190 2026-02-26T02:57:20.655 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:20.656 DEBUG:teuthology.orchestra.run.trial190:> sudo cat /etc/ssh/sshd_config | grep TrustedUserCAKeys 2026-02-26T02:57:20.719 INFO:teuthology.orchestra.run.trial190.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-02-26T02:57:20.720 DEBUG:teuthology.orchestra.run.trial191:> sudo cat /etc/ssh/ca-key.pub 2026-02-26T02:57:20.742 INFO:teuthology.orchestra.run.trial191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCer59q7TMYySpKbVTzmTXEtRdqf6YI6ekxuh/spapFO3ORQyo0lW1I5zVzPwaPjucSGdHAX7x7xP8T/TiQYva6CqTvFq+jwxHhO7HYCq7YviMMtUqS3g/6PYG3yx+vsUAvLsXRBD+/Az8+3mB5+dSIXY4RPrMfdj/3fLube06vovZolXra+RucOhMK5rqqY2ln2Kv4SEHOh5rVH5nhpeSEDdvN/oIVwC1th25WrB4Y495+DDv1GX6VUOCfsCMbSGwpj5QqrtqVVfxFc60r4DS1ZnWkqlxztxd+CGXTTBCJLPG+53eAqYZF6KmXJMcWouKgU2vyMSJ7nz4FD93TpHJrdUZCZ3yMLe3JC9jz9RRLZTcWj6PvbzmMqlarKQVzp+VYOU2HkOTelkaNjhuv0CeOUnf3kkwyl47TDnUIX29XxB93dlSnOU8a0uLV4OGMBTN1DfZV9NIyiXqyp23KI3U0e20CAJyJIHPLwW4OLcaJxqIgtklVSagGzJ508yRM5EU= root@trial190 2026-02-26T02:57:20.742 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:20.743 DEBUG:teuthology.orchestra.run.trial191:> sudo cat /etc/ssh/sshd_config | grep TrustedUserCAKeys 2026-02-26T02:57:20.808 INFO:teuthology.orchestra.run.trial191.stdout:TrustedUserCAKeys /etc/ssh/ca-key.pub 2026-02-26T02:57:20.808 DEBUG:teuthology.orchestra.run.trial190:> sudo ls /root/ 2026-02-26T02:57:20.832 INFO:teuthology.orchestra.run.trial190.stdout:anaconda-ks.cfg 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:ca-key 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:ca-key.pub 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:cephadm-ssh-key 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:cephadm-ssh-key-cert.pub 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:cephadm-ssh-key.pub 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:curtin-install-cfg.yaml 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:curtin-install.log 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:curtin-late-20.efidirs 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:curtin-late-30.esp_grubcfg 2026-02-26T02:57:20.833 INFO:teuthology.orchestra.run.trial190.stdout:original-ks.cfg 2026-02-26T02:57:20.834 DEBUG:teuthology.orchestra.run.trial190:> sudo mkdir -p /etc/ceph 2026-02-26T02:57:20.898 DEBUG:teuthology.orchestra.run.trial191:> sudo mkdir -p /etc/ceph 2026-02-26T02:57:20.924 DEBUG:teuthology.orchestra.run.trial190:> sudo chmod 777 /etc/ceph 2026-02-26T02:57:20.961 DEBUG:teuthology.orchestra.run.trial191:> sudo chmod 777 /etc/ceph 2026-02-26T02:57:20.988 INFO:tasks.cephadm:Writing seed config... 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-26T02:57:20.989 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-26T02:57:20.989 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:20.989 DEBUG:teuthology.orchestra.run.trial190:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-26T02:57:21.018 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d7c43448-12be-11f1-9df6-d404e6e7d460 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-26T02:57:21.018 DEBUG:teuthology.orchestra.run.trial190:mon.a> sudo journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a.service 2026-02-26T02:57:21.060 DEBUG:teuthology.orchestra.run.trial190:mgr.a> sudo journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.a.service 2026-02-26T02:57:21.103 INFO:tasks.cephadm:Bootstrapping... 2026-02-26T02:57:21.103 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 -v bootstrap --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --ssh-private-key /root/cephadm-ssh-key --ssh-signed-cert /root/cephadm-ssh-key-cert.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.190 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-26T02:57:21.236 INFO:teuthology.orchestra.run.trial190.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:57:21.236 INFO:teuthology.orchestra.run.trial190.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', '-v', 'bootstrap', '--fsid', 'd7c43448-12be-11f1-9df6-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--ssh-private-key', '/root/cephadm-ssh-key', '--ssh-signed-cert', '/root/cephadm-ssh-key-cert.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.190', '--skip-admin-label'] 2026-02-26T02:57:21.237 INFO:teuthology.orchestra.run.trial190.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-26T02:57:21.237 INFO:teuthology.orchestra.run.trial190.stdout:Verifying podman|docker is present... 2026-02-26T02:57:21.252 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stdout 5.8.0 2026-02-26T02:57:21.253 INFO:teuthology.orchestra.run.trial190.stdout:Verifying lvm2 is present... 2026-02-26T02:57:21.253 INFO:teuthology.orchestra.run.trial190.stdout:Verifying time synchronization is in place... 2026-02-26T02:57:21.259 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-26T02:57:21.259 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-26T02:57:21.265 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-26T02:57:21.265 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout inactive 2026-02-26T02:57:21.270 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout enabled 2026-02-26T02:57:21.276 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout active 2026-02-26T02:57:21.276 INFO:teuthology.orchestra.run.trial190.stdout:Unit chronyd.service is enabled and running 2026-02-26T02:57:21.276 INFO:teuthology.orchestra.run.trial190.stdout:Repeating the final host check... 2026-02-26T02:57:21.292 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stdout 5.8.0 2026-02-26T02:57:21.292 INFO:teuthology.orchestra.run.trial190.stdout:podman (/bin/podman) version 5.8.0 is present 2026-02-26T02:57:21.292 INFO:teuthology.orchestra.run.trial190.stdout:systemctl is present 2026-02-26T02:57:21.292 INFO:teuthology.orchestra.run.trial190.stdout:lvcreate is present 2026-02-26T02:57:21.296 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-26T02:57:21.297 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-26T02:57:21.302 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-26T02:57:21.302 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout inactive 2026-02-26T02:57:21.308 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout enabled 2026-02-26T02:57:21.314 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout active 2026-02-26T02:57:21.314 INFO:teuthology.orchestra.run.trial190.stdout:Unit chronyd.service is enabled and running 2026-02-26T02:57:21.314 INFO:teuthology.orchestra.run.trial190.stdout:Host looks OK 2026-02-26T02:57:21.314 INFO:teuthology.orchestra.run.trial190.stdout:Cluster fsid: d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:21.314 INFO:teuthology.orchestra.run.trial190.stdout:Acquiring lock 139842368536144 on /run/cephadm/d7c43448-12be-11f1-9df6-d404e6e7d460.lock 2026-02-26T02:57:21.314 INFO:teuthology.orchestra.run.trial190.stdout:Lock 139842368536144 acquired on /run/cephadm/d7c43448-12be-11f1-9df6-d404e6e7d460.lock 2026-02-26T02:57:21.315 INFO:teuthology.orchestra.run.trial190.stdout:Verifying IP 10.20.193.190 port 3300 ... 2026-02-26T02:57:21.315 INFO:teuthology.orchestra.run.trial190.stdout:Verifying IP 10.20.193.190 port 6789 ... 2026-02-26T02:57:21.315 INFO:teuthology.orchestra.run.trial190.stdout:Base mon IP(s) is [10.20.193.190:3300, 10.20.193.190:6789], mon addrv is [v2:10.20.193.190:3300,v1:10.20.193.190:6789] 2026-02-26T02:57:21.318 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.190 metric 102 2026-02-26T02:57:21.318 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.190 metric 102 2026-02-26T02:57:21.318 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-26T02:57:21.320 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-26T02:57:21.320 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-26T02:57:21.320 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout inet6 fe80::e954:5b4c:62ca:9c7c/64 scope link noprefixroute 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:5f90/64 scope link 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:Mon IP `10.20.193.190` is in CIDR network `10.20.192.0/20` 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:Mon IP `10.20.193.190` is in CIDR network `10.20.192.0/20` 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-26T02:57:21.323 INFO:teuthology.orchestra.run.trial190.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5... 2026-02-26T02:57:21.590 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stdout d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae 2026-02-26T02:57:21.590 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5... 2026-02-26T02:57:21.590 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stderr Getting image source signatures 2026-02-26T02:57:21.590 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stderr Copying blob sha256:c1772b0fefd70d25a33169c6bbdc268bff32130f6c75045340cded278a95f1cb 2026-02-26T02:57:21.590 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-02-26T02:57:21.590 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stderr Copying config sha256:d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae 2026-02-26T02:57:21.590 INFO:teuthology.orchestra.run.trial190.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-26T02:57:21.841 INFO:teuthology.orchestra.run.trial190.stdout:ceph: stdout ceph version 19.2.3-687-g8d724284 (8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5) squid (stable) 2026-02-26T02:57:21.841 INFO:teuthology.orchestra.run.trial190.stdout:Ceph version: ceph version 19.2.3-687-g8d724284 (8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5) squid (stable) 2026-02-26T02:57:21.841 INFO:teuthology.orchestra.run.trial190.stdout:Extracting ceph user uid/gid from container image... 2026-02-26T02:57:22.118 INFO:teuthology.orchestra.run.trial190.stdout:stat: stdout 167 167 2026-02-26T02:57:22.118 INFO:teuthology.orchestra.run.trial190.stdout:Creating initial keys... 2026-02-26T02:57:22.399 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph-authtool: stdout AQCStp9pQeNwDxAApIq2pYHfs0yYyLIBu7I/8A== 2026-02-26T02:57:22.657 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph-authtool: stdout AQCStp9pkOJCIBAAdzSgOOMzp2g0F2L29febGA== 2026-02-26T02:57:22.912 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph-authtool: stdout AQCStp9pz/lhLxAA+BHCWxQkNF8Exd+QsnyCdQ== 2026-02-26T02:57:22.913 INFO:teuthology.orchestra.run.trial190.stdout:Creating initial monmap... 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:monmaptool for a [v2:10.20.193.190:3300,v1:10.20.193.190:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:setting min_mon_release = quincy 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/monmaptool: set fsid to d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-26T02:57:23.188 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:23.189 INFO:teuthology.orchestra.run.trial190.stdout:Creating mon... 2026-02-26T02:57:23.451 INFO:teuthology.orchestra.run.trial190.stdout:create mon.a on 2026-02-26T02:57:23.623 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-26T02:57:23.724 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-26T02:57:23.843 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460.target → /etc/systemd/system/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460.target. 2026-02-26T02:57:23.843 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460.target → /etc/systemd/system/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460.target. 2026-02-26T02:57:23.967 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a 2026-02-26T02:57:23.968 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a.service: Unit ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a.service not loaded. 2026-02-26T02:57:24.093 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460.target.wants/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@.service. 2026-02-26T02:57:24.233 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-26T02:57:24.233 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout disabled 2026-02-26T02:57:24.239 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-26T02:57:24.239 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout inactive 2026-02-26T02:57:24.240 INFO:teuthology.orchestra.run.trial190.stdout:firewalld.service is not enabled 2026-02-26T02:57:24.240 INFO:teuthology.orchestra.run.trial190.stdout:Not possible to enable service . firewalld.service is not available 2026-02-26T02:57:24.240 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for mon to start... 2026-02-26T02:57:24.240 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for mon... 2026-02-26T02:57:24.517 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout cluster: 2026-02-26T02:57:24.517 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout id: d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:24.517 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-26T02:57:24.517 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:24.517 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout services: 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.148939s) 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout data: 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout pgs: 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:24.518 INFO:teuthology.orchestra.run.trial190.stdout:mon is available 2026-02-26T02:57:24.519 INFO:teuthology.orchestra.run.trial190.stdout:Assimilating anything we can from ceph.conf... 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout [global] 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout fsid = d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.190:3300,v1:10.20.193.190:6789] 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout [osd] 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-26T02:57:24.791 INFO:teuthology.orchestra.run.trial190.stdout:Generating new minimal ceph.conf... 2026-02-26T02:57:25.070 INFO:teuthology.orchestra.run.trial190.stdout:Restarting the monitor... 2026-02-26T02:57:25.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a[40037]: 2026-02-26T02:57:25.144+0000 7f0845228640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-26T02:57:25.660 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 podman[40435]: 2026-02-26 02:57:25.378529678 +0000 UTC m=+0.245673955 container died f3f727244b12c37d03644601c52c315a89710509960ee92dac06ff06818128d8 (image=quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, OSD_FLAVOR=default) 2026-02-26T02:57:25.660 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 podman[40435]: 2026-02-26 02:57:25.491431043 +0000 UTC m=+0.358575330 container remove f3f727244b12c37d03644601c52c315a89710509960ee92dac06ff06818128d8 (image=quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default) 2026-02-26T02:57:25.660 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 bash[40435]: ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a 2026-02-26T02:57:25.661 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 systemd[1]: ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-26T02:57:25.661 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 systemd[1]: Stopped Ceph mon.a for d7c43448-12be-11f1-9df6-d404e6e7d460. 2026-02-26T02:57:25.661 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 systemd[1]: Starting Ceph mon.a for d7c43448-12be-11f1-9df6-d404e6e7d460... 2026-02-26T02:57:25.661 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 podman[40575]: 2026-02-26 02:57:25.621594739 +0000 UTC m=+0.014850046 container create 9eef46b8eb94dd0581b6e8305ea54f8e254da28d99e3dd83b3b430ca9a0fcb9b (image=quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-26T02:57:25.670 INFO:teuthology.orchestra.run.trial190.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 podman[40575]: 2026-02-26 02:57:25.660909584 +0000 UTC m=+0.054164891 container init 9eef46b8eb94dd0581b6e8305ea54f8e254da28d99e3dd83b3b430ca9a0fcb9b (image=quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, io.buildah.version=1.41.3, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 podman[40575]: 2026-02-26 02:57:25.664391786 +0000 UTC m=+0.057647093 container start 9eef46b8eb94dd0581b6e8305ea54f8e254da28d99e3dd83b3b430ca9a0fcb9b (image=quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a, org.label-schema.build-date=20260223, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, ceph=True, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 bash[40575]: 9eef46b8eb94dd0581b6e8305ea54f8e254da28d99e3dd83b3b430ca9a0fcb9b 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 podman[40575]: 2026-02-26 02:57:25.615600014 +0000 UTC m=+0.008855331 image pull d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 systemd[1]: Started Ceph mon.a for d7c43448-12be-11f1-9df6-d404e6e7d460. 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: set uid:gid to 167:167 (ceph:ceph) 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: ceph version 19.2.3-687-g8d724284 (8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5) squid (stable), process ceph-mon, pid 7 2026-02-26T02:57:25.942 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: pidfile_write: ignore empty --pid-file 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: load: jerasure load: lrc 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: RocksDB version: 7.9.2 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Git sha 0 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Compile date 2026-02-25 22:53:16 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: DB SUMMARY 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: DB Session ID: 5QCUWDZYBM0G3W3VWKAM 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: CURRENT file: CURRENT 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: IDENTITY file: IDENTITY 2026-02-26T02:57:25.943 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 74989 ; 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.error_if_exists: 0 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.create_if_missing: 0 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.paranoid_checks: 1 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.env: 0x564c74aebdc0 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.fs: PosixFileSystem 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.info_log: 0x564c75d8ad00 2026-02-26T02:57:25.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_file_opening_threads: 16 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.statistics: (nil) 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.use_fsync: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_log_file_size: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.keep_log_file_num: 1000 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.recycle_log_file_num: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.allow_fallocate: 1 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.allow_mmap_reads: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.allow_mmap_writes: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.use_direct_reads: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-26T02:57:25.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.create_missing_column_families: 0 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.db_log_dir: 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.wal_dir: 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.advise_random_on_open: 1 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.db_write_buffer_size: 0 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.write_buffer_manager: 0x564c75d8f900 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-26T02:57:25.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.rate_limiter: (nil) 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.wal_recovery_mode: 2 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.enable_thread_tracking: 0 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.enable_pipelined_write: 0 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.unordered_write: 0 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.row_cache: None 2026-02-26T02:57:25.947 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.wal_filter: None 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.allow_ingest_behind: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.two_write_queues: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.manual_wal_flush: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.wal_compression: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.atomic_flush: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.log_readahead_size: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.best_efforts_recovery: 0 2026-02-26T02:57:25.948 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.allow_data_in_errors: 0 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.db_host_id: __hostname__ 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_background_jobs: 2 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_background_compactions: -1 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_subcompactions: 1 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_total_wal_size: 0 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-26T02:57:25.949 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_open_files: -1 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bytes_per_sync: 0 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_readahead_size: 0 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_background_flushes: -1 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Compression algorithms supported: 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kZSTD supported: 0 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kXpressCompression supported: 0 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kBZip2Compression supported: 0 2026-02-26T02:57:25.950 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kLZ4Compression supported: 1 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kZlibCompression supported: 1 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kLZ4HCCompression supported: 1 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: kSnappyCompression supported: 1 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.merge_operator: 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_filter: None 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_filter_factory: None 2026-02-26T02:57:25.951 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.sst_partitioner_factory: None 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564c75d8a480) 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: cache_index_and_filter_blocks: 1 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: pin_top_level_index_and_filter: 1 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: index_type: 0 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: data_block_index_type: 0 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: index_shortening: 1 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: checksum: 4 2026-02-26T02:57:25.952 INFO:journalctl@ceph.mon.a.trial190.stdout: no_block_cache: 0 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: block_cache: 0x564c75daf350 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: block_cache_name: BinnedLRUCache 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: block_cache_options: 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: capacity : 536870912 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: num_shard_bits : 4 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: strict_capacity_limit : 0 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: high_pri_pool_ratio: 0.000 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: block_cache_compressed: (nil) 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: persistent_cache: (nil) 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: block_size: 4096 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: block_size_deviation: 10 2026-02-26T02:57:25.953 INFO:journalctl@ceph.mon.a.trial190.stdout: block_restart_interval: 16 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: index_block_restart_interval: 1 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: metadata_block_size: 4096 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: partition_filters: 0 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: use_delta_encoding: 1 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: filter_policy: bloomfilter 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: whole_key_filtering: 1 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: verify_compression: 0 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: read_amp_bytes_per_bit: 0 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: format_version: 5 2026-02-26T02:57:25.954 INFO:journalctl@ceph.mon.a.trial190.stdout: enable_index_compression: 1 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout: block_align: 0 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout: max_auto_readahead_size: 262144 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout: prepopulate_block_cache: 0 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout: initial_auto_readahead_size: 8192 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout: num_file_reads_for_auto_readahead: 2 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.write_buffer_size: 33554432 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_write_buffer_number: 2 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression: NoCompression 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression: Disabled 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.prefix_extractor: nullptr 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.num_levels: 7 2026-02-26T02:57:25.955 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-26T02:57:25.956 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.level: 32767 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.strategy: 0 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.enabled: false 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.target_file_size_base: 67108864 2026-02-26T02:57:25.957 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-26T02:57:25.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.arena_block_size: 1048576 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.disable_auto_compactions: 0 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-26T02:57:25.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.inplace_update_support: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.bloom_locality: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.max_successive_merges: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.paranoid_file_checks: 0 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.force_consistency_checks: 1 2026-02-26T02:57:25.960 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.report_bg_io_stats: 0 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.ttl: 2592000 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.enable_blob_files: false 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.min_blob_size: 0 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.blob_file_size: 268435456 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-26T02:57:25.961 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.blob_file_starting_level: 0 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8f4c4b23-1e18-4c19-bd77-81acc2e22a7e 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: EVENT_LOG_v1 {"time_micros": 1772074645682323, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: EVENT_LOG_v1 {"time_micros": 1772074645683118, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 72130, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 223, "table_properties": {"data_size": 70401, "index_size": 178, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9550, "raw_average_key_size": 49, "raw_value_size": 64973, "raw_average_value_size": 334, "num_data_blocks": 8, "num_entries": 194, "num_filter_entries": 194, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1772074645, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8f4c4b23-1e18-4c19-bd77-81acc2e22a7e", "db_session_id": "5QCUWDZYBM0G3W3VWKAM", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: EVENT_LOG_v1 {"time_micros": 1772074645683179, "job": 1, "event": "recovery_finished"} 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564c75db0e00 2026-02-26T02:57:25.962 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: DB pointer 0x564c75eba000 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: ** DB Stats ** 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: ** Compaction Stats [default] ** 2026-02-26T02:57:25.963 INFO:journalctl@ceph.mon.a.trial190.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: L0 2/0 72.30 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: Sum 2/0 72.30 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: ** Compaction Stats [default] ** 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-26T02:57:25.964 INFO:journalctl@ceph.mon.a.trial190.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: Cumulative compaction: 0.00 GB write, 22.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-26T02:57:25.965 INFO:journalctl@ceph.mon.a.trial190.stdout: Interval compaction: 0.00 GB write, 22.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: Block cache BinnedLRUCache@0x564c75daf350#7 capacity: 512.00 MB usage: 26.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 0.000132 secs_since: 0 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.70 KB,0.00013411%) IndexBlock(2,0.38 KB,7.15256e-05%) Misc(4,25.11 KB,0.00478923%) 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: starting mon.a rank 0 at public addrs [v2:10.20.193.190:3300/0,v1:10.20.193.190:6789/0] at bind addrs [v2:10.20.193.190:3300/0,v1:10.20.193.190:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???) e1 preinit fsid d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???).mds e1 new map 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???).mds e1 print_map 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: e1 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: btime 2026-02-26T02:57:24:244992+0000 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-26T02:57:25.966 INFO:journalctl@ceph.mon.a.trial190.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout: legacy client fscid: -1 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout: 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout: No filesystems configured 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: monmap epoch 1 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: fsid d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:25.967 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: last_changed 2026-02-26T02:57:23.059133+0000 2026-02-26T02:57:25.968 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: created 2026-02-26T02:57:23.059133+0000 2026-02-26T02:57:25.968 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: min_mon_release 19 (squid) 2026-02-26T02:57:25.968 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: election_strategy: 1 2026-02-26T02:57:25.968 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: 0: [v2:10.20.193.190:3300/0,v1:10.20.193.190:6789/0] mon.a 2026-02-26T02:57:25.968 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: fsmap 2026-02-26T02:57:25.968 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: osdmap e1: 0 total, 0 up, 0 in 2026-02-26T02:57:25.968 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:25 trial190 ceph-mon[40625]: mgrmap e1: no daemons active 2026-02-26T02:57:25.969 INFO:teuthology.orchestra.run.trial190.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-26T02:57:25.969 INFO:teuthology.orchestra.run.trial190.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-26T02:57:25.969 INFO:teuthology.orchestra.run.trial190.stdout:Creating mgr... 2026-02-26T02:57:25.969 INFO:teuthology.orchestra.run.trial190.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-26T02:57:25.969 INFO:teuthology.orchestra.run.trial190.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-26T02:57:26.084 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.a 2026-02-26T02:57:26.084 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.a.service: Unit ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.a.service not loaded. 2026-02-26T02:57:26.199 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460.target.wants/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@.service. 2026-02-26T02:57:26.359 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-26T02:57:26.359 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout disabled 2026-02-26T02:57:26.366 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-26T02:57:26.366 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout inactive 2026-02-26T02:57:26.366 INFO:teuthology.orchestra.run.trial190.stdout:firewalld.service is not enabled 2026-02-26T02:57:26.366 INFO:teuthology.orchestra.run.trial190.stdout:Not possible to enable service . firewalld.service is not available 2026-02-26T02:57:26.373 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-26T02:57:26.373 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout disabled 2026-02-26T02:57:26.378 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-26T02:57:26.378 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout inactive 2026-02-26T02:57:26.379 INFO:teuthology.orchestra.run.trial190.stdout:firewalld.service is not enabled 2026-02-26T02:57:26.379 INFO:teuthology.orchestra.run.trial190.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-26T02:57:26.379 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for mgr to start... 2026-02-26T02:57:26.379 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for mgr... 2026-02-26T02:57:26.675 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout { 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "fsid": "d7c43448-12be-11f1-9df6-d404e6e7d460", 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "health": { 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:26.676 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 0 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "a" 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-26T02:57:26.677 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-26T02:57:26.678 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:26.679 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "btime": "2026-02-26T02:57:24:244992+0000", 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "restful" 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:26.680 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "modified": "2026-02-26T02:57:24.245557+0000", 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout } 2026-02-26T02:57:26.681 INFO:teuthology.orchestra.run.trial190.stdout:mgr not available, waiting (1/15)... 2026-02-26T02:57:26.994 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:26 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/622513788' entity='client.admin' 2026-02-26T02:57:26.995 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:26 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3921358472' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-26T02:57:26.995 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:26 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:26.961+0000 7eff9be14140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-26T02:57:26.995 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:26 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:26.992+0000 7eff9be14140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.027+0000 7eff9be14140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.093+0000 7eff9be14140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: from numpy import show_config as show_numpy_config 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.167+0000 7eff9be14140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.201+0000 7eff9be14140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-26T02:57:27.299 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.297+0000 7eff9be14140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-26T02:57:27.727 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.356+0000 7eff9be14140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-26T02:57:27.727 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.390+0000 7eff9be14140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-26T02:57:27.727 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.423+0000 7eff9be14140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-26T02:57:27.727 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.458+0000 7eff9be14140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-26T02:57:27.727 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.488+0000 7eff9be14140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-26T02:57:27.988 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.731+0000 7eff9be14140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-26T02:57:27.988 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.830+0000 7eff9be14140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-26T02:57:27.988 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.861+0000 7eff9be14140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-26T02:57:27.988 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.892+0000 7eff9be14140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-26T02:57:27.988 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:27 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:27.985+0000 7eff9be14140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:57:28.477 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:28 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:28.014+0000 7eff9be14140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-26T02:57:28.477 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:28 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:28.106+0000 7eff9be14140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:57:28.828 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:28 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:28.559+0000 7eff9be14140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-26T02:57:28.828 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:28 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:28.590+0000 7eff9be14140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout { 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "fsid": "d7c43448-12be-11f1-9df6-d404e6e7d460", 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "health": { 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 0 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "a" 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-26T02:57:28.951 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-26T02:57:28.952 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "btime": "2026-02-26T02:57:24:244992+0000", 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-26T02:57:28.953 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "restful" 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "modified": "2026-02-26T02:57:24.245557+0000", 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout } 2026-02-26T02:57:28.954 INFO:teuthology.orchestra.run.trial190.stdout:mgr not available, waiting (2/15)... 2026-02-26T02:57:29.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:28 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/50455185' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-26T02:57:29.228 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:29.003+0000 7eff9be14140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: Activating manager daemon a 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: mgrmap e2: a(active, starting, since 0.00234668s) 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-26T02:57:30.228 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: Manager daemon a is now available 2026-02-26T02:57:30.229 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-26T02:57:30.229 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-26T02:57:30.229 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' 2026-02-26T02:57:30.229 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' 2026-02-26T02:57:30.229 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:29 trial190 ceph-mon[40625]: from='mgr.14100 10.20.193.190:0/713937235' entity='mgr.a' 2026-02-26T02:57:31.310 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:31 trial190 ceph-mon[40625]: mgrmap e3: a(active, since 1.0046s) 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout { 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "fsid": "d7c43448-12be-11f1-9df6-d404e6e7d460", 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "health": { 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 0 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:31.317 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "a" 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-26T02:57:31.318 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-26T02:57:31.321 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:31.321 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-26T02:57:31.321 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-26T02:57:31.321 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-26T02:57:31.321 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "btime": "2026-02-26T02:57:24:244992+0000", 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-26T02:57:31.322 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "restful" 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout ], 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-26T02:57:31.323 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "modified": "2026-02-26T02:57:24.245557+0000", 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout }, 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout } 2026-02-26T02:57:31.324 INFO:teuthology.orchestra.run.trial190.stdout:mgr is available 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout [global] 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout fsid = d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.190:3300,v1:10.20.193.190:6789] 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-26T02:57:31.660 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout [osd] 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-26T02:57:31.661 INFO:teuthology.orchestra.run.trial190.stdout:Enabling cephadm module... 2026-02-26T02:57:32.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-mon[40625]: mgrmap e4: a(active, since 2s) 2026-02-26T02:57:32.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2621867740' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-26T02:57:32.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2662803704' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-26T02:57:32.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2662803704' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-26T02:57:32.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2836666579' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-26T02:57:32.892 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: ignoring --setuser ceph since I am not root 2026-02-26T02:57:32.892 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: ignoring --setgroup ceph since I am not root 2026-02-26T02:57:33.131 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout { 2026-02-26T02:57:33.132 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-26T02:57:33.132 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-26T02:57:33.132 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-26T02:57:33.132 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-26T02:57:33.132 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout } 2026-02-26T02:57:33.132 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for the mgr to restart... 2026-02-26T02:57:33.132 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for mgr epoch 5... 2026-02-26T02:57:33.154 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:32 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:32.946+0000 7ff63f63c140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-26T02:57:33.154 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.094+0000 7ff63f63c140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-26T02:57:33.154 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.131+0000 7ff63f63c140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-26T02:57:33.420 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.175+0000 7ff63f63c140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.208+0000 7ff63f63c140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.243+0000 7ff63f63c140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.311+0000 7ff63f63c140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: from numpy import show_config as show_numpy_config 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.384+0000 7ff63f63c140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-26T02:57:33.421 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.418+0000 7ff63f63c140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-26T02:57:33.678 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2836666579' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-26T02:57:33.678 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-mon[40625]: mgrmap e5: a(active, since 3s) 2026-02-26T02:57:33.679 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2339576866' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-26T02:57:33.679 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.514+0000 7ff63f63c140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-26T02:57:33.679 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.574+0000 7ff63f63c140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-26T02:57:33.679 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.608+0000 7ff63f63c140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-26T02:57:33.679 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.641+0000 7ff63f63c140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-26T02:57:33.679 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.676+0000 7ff63f63c140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-26T02:57:33.945 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.707+0000 7ff63f63c140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-26T02:57:33.945 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:33 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:33.943+0000 7ff63f63c140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-26T02:57:34.201 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.043+0000 7ff63f63c140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-26T02:57:34.201 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.074+0000 7ff63f63c140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-26T02:57:34.201 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.105+0000 7ff63f63c140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-26T02:57:34.201 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.199+0000 7ff63f63c140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:57:34.477 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.228+0000 7ff63f63c140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-26T02:57:34.477 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.321+0000 7ff63f63c140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:57:35.211 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.779+0000 7ff63f63c140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-26T02:57:35.211 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:34 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:34.809+0000 7ff63f63c140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-26T02:57:35.211 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:35.209+0000 7ff63f63c140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-26T02:57:35.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: Active manager daemon a restarted 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: Activating manager daemon a 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: osdmap e2: 0 total, 0 up, 0 in 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: mgrmap e6: a(active, starting, since 0.00310174s) 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: Manager daemon a is now available 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-26T02:57:35.478 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:35 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-26T02:57:36.342 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout { 2026-02-26T02:57:36.342 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-26T02:57:36.343 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-26T02:57:36.343 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout } 2026-02-26T02:57:36.343 INFO:teuthology.orchestra.run.trial190.stdout:mgr epoch 5 is available 2026-02-26T02:57:36.343 INFO:teuthology.orchestra.run.trial190.stdout:Setting orchestrator backend to cephadm... 2026-02-26T02:57:36.879 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:36 trial190 ceph-mon[40625]: Found migration_current of "None". Setting to last migration. 2026-02-26T02:57:36.880 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:36 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:36.880 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:36 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:36.880 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:36 trial190 ceph-mon[40625]: mgrmap e7: a(active, since 1.00353s) 2026-02-26T02:57:36.880 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:36 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:36.880 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:36 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:36.880 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:36 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:37.001 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-26T02:57:37.001 INFO:teuthology.orchestra.run.trial190.stdout:Using provided ssh private key and signed cert ... 2026-02-26T02:57:37.671 INFO:teuthology.orchestra.run.trial190.stdout:Adding host trial190... 2026-02-26T02:57:37.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-26T02:57:37.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-26T02:57:37.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:36] ENGINE Bus STARTING 2026-02-26T02:57:37.958 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:36] ENGINE Serving on https://10.20.193.190:7150 2026-02-26T02:57:37.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:36] ENGINE Client ('10.20.193.190', 55584) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-26T02:57:37.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:36] ENGINE Serving on http://10.20.193.190:8765 2026-02-26T02:57:37.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:36] ENGINE Bus STARTED 2026-02-26T02:57:37.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:37.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:37.959 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:37 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:38.843 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:38 trial190 ceph-mon[40625]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:38.843 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:38 trial190 ceph-mon[40625]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-priv-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:38.843 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:38 trial190 ceph-mon[40625]: Set ssh ssh_identity_key 2026-02-26T02:57:38.844 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:38 trial190 ceph-mon[40625]: Set ssh private key 2026-02-26T02:57:38.844 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:38 trial190 ceph-mon[40625]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:38.844 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:38 trial190 ceph-mon[40625]: Set ssh ssh_identity_cert 2026-02-26T02:57:38.844 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:38 trial190 ceph-mon[40625]: mgrmap e8: a(active, since 2s) 2026-02-26T02:57:39.861 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:39 trial190 ceph-mon[40625]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial190", "addr": "10.20.193.190", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:39.861 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:39 trial190 ceph-mon[40625]: Deploying cephadm binary to trial190 2026-02-26T02:57:40.210 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout Added host 'trial190' with addr '10.20.193.190' 2026-02-26T02:57:40.210 INFO:teuthology.orchestra.run.trial190.stdout:Deploying unmanaged mon service... 2026-02-26T02:57:40.546 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-26T02:57:40.546 INFO:teuthology.orchestra.run.trial190.stdout:Deploying unmanaged mgr service... 2026-02-26T02:57:40.896 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: Added host trial190 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: Saving service mon spec with placement count:5 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:41.343 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:41 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:41.584 INFO:teuthology.orchestra.run.trial190.stdout:Enabling the dashboard module... 2026-02-26T02:57:42.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-mon[40625]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:42.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-mon[40625]: Saving service mgr spec with placement count:2 2026-02-26T02:57:42.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/4038265108' entity='client.admin' 2026-02-26T02:57:42.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:42.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/1941730590' entity='client.admin' 2026-02-26T02:57:42.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-mon[40625]: from='mgr.14118 10.20.193.190:0/2266254367' entity='mgr.a' 2026-02-26T02:57:42.477 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3600088204' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-26T02:57:42.943 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: ignoring --setuser ceph since I am not root 2026-02-26T02:57:42.944 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:42 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: ignoring --setgroup ceph since I am not root 2026-02-26T02:57:43.069 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout { 2026-02-26T02:57:43.069 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-26T02:57:43.070 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-26T02:57:43.070 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-26T02:57:43.070 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-26T02:57:43.070 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout } 2026-02-26T02:57:43.070 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for the mgr to restart... 2026-02-26T02:57:43.070 INFO:teuthology.orchestra.run.trial190.stdout:Waiting for mgr epoch 9... 2026-02-26T02:57:43.200 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.011+0000 7fbb33770140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-26T02:57:43.200 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.163+0000 7fbb33770140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-26T02:57:43.200 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.198+0000 7fbb33770140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-26T02:57:43.477 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.241+0000 7fbb33770140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-26T02:57:43.477 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.273+0000 7fbb33770140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-26T02:57:43.478 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.307+0000 7fbb33770140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-26T02:57:43.478 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.374+0000 7fbb33770140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-26T02:57:43.478 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-26T02:57:43.478 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-26T02:57:43.478 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: from numpy import show_config as show_numpy_config 2026-02-26T02:57:43.478 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.448+0000 7fbb33770140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3600088204' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-mon[40625]: mgrmap e9: a(active, since 7s) 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2979464880' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.483+0000 7fbb33770140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.580+0000 7fbb33770140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.640+0000 7fbb33770140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.675+0000 7fbb33770140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.708+0000 7fbb33770140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-26T02:57:43.746 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.744+0000 7fbb33770140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-26T02:57:44.013 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:43 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:43.775+0000 7fbb33770140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-26T02:57:44.271 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.011+0000 7fbb33770140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-26T02:57:44.271 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.112+0000 7fbb33770140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-26T02:57:44.271 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.143+0000 7fbb33770140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-26T02:57:44.271 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.175+0000 7fbb33770140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-26T02:57:44.271 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.269+0000 7fbb33770140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:57:44.728 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.298+0000 7fbb33770140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-26T02:57:44.728 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.392+0000 7fbb33770140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:57:45.227 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.861+0000 7fbb33770140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-26T02:57:45.227 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:44 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:44.892+0000 7fbb33770140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-26T02:57:45.727 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:57:45.293+0000 7fbb33770140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: Active manager daemon a restarted 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: Activating manager daemon a 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: osdmap e3: 0 total, 0 up, 0 in 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: mgrmap e10: a(active, starting, since 0.00226972s) 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: Manager daemon a is now available 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-26T02:57:45.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:45 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-26T02:57:46.428 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout { 2026-02-26T02:57:46.428 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-26T02:57:46.429 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-26T02:57:46.429 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout } 2026-02-26T02:57:46.429 INFO:teuthology.orchestra.run.trial190.stdout:mgr epoch 9 is available 2026-02-26T02:57:46.429 INFO:teuthology.orchestra.run.trial190.stdout:Generating a dashboard self-signed certificate... 2026-02-26T02:57:46.830 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-26T02:57:46.830 INFO:teuthology.orchestra.run.trial190.stdout:Creating initial admin user... 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:46] ENGINE Bus STARTING 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:46] ENGINE Serving on http://10.20.193.190:8765 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:46] ENGINE Serving on https://10.20.193.190:7150 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:46] ENGINE Bus STARTED 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: [26/Feb/2026:02:57:46] ENGINE Client ('10.20.193.190', 49652) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: mgrmap e11: a(active, since 1.00405s) 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:47.183 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:46 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:47.306 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$HvvqHwTDPFJRpZQHRDATZe/LgUHjle/2kBJ8CCgml/HEbcPLCuuq2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1772074667, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-26T02:57:47.307 INFO:teuthology.orchestra.run.trial190.stdout:Fetching dashboard port number... 2026-02-26T02:57:47.639 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stdout 8443 2026-02-26T02:57:47.648 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-26T02:57:47.648 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout disabled 2026-02-26T02:57:47.654 INFO:teuthology.orchestra.run.trial190.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-26T02:57:47.654 INFO:teuthology.orchestra.run.trial190.stdout:systemctl: stdout inactive 2026-02-26T02:57:47.654 INFO:teuthology.orchestra.run.trial190.stdout:firewalld.service is not enabled 2026-02-26T02:57:47.655 INFO:teuthology.orchestra.run.trial190.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-26T02:57:47.656 INFO:teuthology.orchestra.run.trial190.stdout:Ceph Dashboard is now available at: 2026-02-26T02:57:47.656 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:47.656 INFO:teuthology.orchestra.run.trial190.stdout: URL: https://trial190:8443/ 2026-02-26T02:57:47.656 INFO:teuthology.orchestra.run.trial190.stdout: User: admin 2026-02-26T02:57:47.656 INFO:teuthology.orchestra.run.trial190.stdout: Password: fggtx0iz8s 2026-02-26T02:57:47.656 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:47.656 INFO:teuthology.orchestra.run.trial190.stdout:Saving cluster configuration to /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config directory 2026-02-26T02:57:48.030 INFO:teuthology.orchestra.run.trial190.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-26T02:57:48.030 INFO:teuthology.orchestra.run.trial190.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-26T02:57:48.030 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.030 INFO:teuthology.orchestra.run.trial190.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout:Or, if you are only running a single cluster on this host: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: ceph telemetry on 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout:For more information see: 2026-02-26T02:57:48.031 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.032 INFO:teuthology.orchestra.run.trial190.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-26T02:57:48.032 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:48.032 INFO:teuthology.orchestra.run.trial190.stdout:Bootstrap complete. 2026-02-26T02:57:48.057 INFO:tasks.cephadm:Fetching config... 2026-02-26T02:57:48.058 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:48.058 DEBUG:teuthology.orchestra.run.trial190:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-26T02:57:48.077 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-26T02:57:48.077 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:48.077 DEBUG:teuthology.orchestra.run.trial190:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-26T02:57:48.133 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-26T02:57:48.133 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:57:48.133 DEBUG:teuthology.orchestra.run.trial190:> sudo dd if=/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-26T02:57:48.202 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-26T02:57:48.385 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:57:48.407 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:48 trial190 ceph-mon[40625]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:48.407 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:48 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:48.407 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:48 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/1527081127' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-26T02:57:48.407 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:48 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2111468252' entity='client.admin' 2026-02-26T02:57:48.754 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-26T02:57:48.754 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-26T02:57:48.902 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:57:49.261 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial191 2026-02-26T02:57:49.261 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:57:49.261 DEBUG:teuthology.orchestra.run.trial191:> dd of=/etc/ceph/ceph.conf 2026-02-26T02:57:49.279 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:57:49.280 DEBUG:teuthology.orchestra.run.trial191:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-26T02:57:49.336 INFO:tasks.cephadm:Adding host trial191 to orchestrator... 2026-02-26T02:57:49.336 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph orch host add trial191 2026-02-26T02:57:49.436 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:49 trial190 ceph-mon[40625]: mgrmap e12: a(active, since 2s) 2026-02-26T02:57:49.436 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:49 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/1317580739' entity='client.admin' 2026-02-26T02:57:49.437 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:49 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:49.487 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:57:50.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:50.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:50.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:50.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial190", "name": "osd_memory_target"}]: dispatch 2026-02-26T02:57:50.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:57:50.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:57:50.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: Updating trial190:/etc/ceph/ceph.conf 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: Updating trial190:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.conf 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: Updating trial190:/etc/ceph/ceph.client.admin.keyring 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:57:50.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:50 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:51.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:51 trial190 ceph-mon[40625]: Updating trial190:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-26T02:57:51.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:51 trial190 ceph-mon[40625]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial191", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:51.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:51 trial190 ceph-mon[40625]: Deploying cephadm binary to trial191 2026-02-26T02:57:52.046 INFO:teuthology.orchestra.run.trial190.stdout:Added host 'trial191' with addr '10.20.193.191' 2026-02-26T02:57:52.189 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-26T02:57:52.335 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:57:52.556 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:57:52.556 INFO:teuthology.orchestra.run.trial190.stdout:[{"addr": "10.20.193.190", "hostname": "trial190", "labels": [], "status": ""}, {"addr": "10.20.193.191", "hostname": "trial191", "labels": [], "status": ""}] 2026-02-26T02:57:52.674 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:52 trial190 ceph-mon[40625]: mgrmap e13: a(active, since 6s) 2026-02-26T02:57:52.674 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:52 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:52.674 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:52 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:57:52.674 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:52 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:52.694 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-26T02:57:52.695 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd crush tunables default 2026-02-26T02:57:52.840 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:57:53.363 INFO:teuthology.orchestra.run.trial190.stderr:adjusted tunables profile to default 2026-02-26T02:57:53.507 INFO:tasks.cephadm:Adding mon.a on trial190 2026-02-26T02:57:53.508 INFO:tasks.cephadm:Adding mon.b on trial191 2026-02-26T02:57:53.508 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph orch apply mon '2;trial190:10.20.193.190=a;trial191:10.20.193.191=b' 2026-02-26T02:57:53.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:53 trial190 ceph-mon[40625]: Added host trial191 2026-02-26T02:57:53.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:53 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:53.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:53 trial190 ceph-mon[40625]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-26T02:57:53.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:53 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/816289881' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-26T02:57:53.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:53 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:53.740 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-26T02:57:53.775 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-26T02:57:54.009 INFO:teuthology.orchestra.run.trial191.stdout:Scheduled mon update... 2026-02-26T02:57:54.148 DEBUG:teuthology.orchestra.run.trial191:mon.b> sudo journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.b.service 2026-02-26T02:57:54.150 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-26T02:57:54.150 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph mon dump -f json 2026-02-26T02:57:54.331 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-26T02:57:54.361 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-26T02:57:54.675 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:57:54.675 INFO:teuthology.orchestra.run.trial191.stdout:{"epoch":1,"fsid":"d7c43448-12be-11f1-9df6-d404e6e7d460","modified":"2026-02-26T02:57:23.059133Z","created":"2026-02-26T02:57:23.059133Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:3300","nonce":0},{"type":"v1","addr":"10.20.193.190:6789","nonce":0}]},"addr":"10.20.193.190:6789/0","public_addr":"10.20.193.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-26T02:57:54.675 INFO:teuthology.orchestra.run.trial191.stderr:dumped monmap epoch 1 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/816289881' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: osdmap e4: 0 total, 0 up, 0 in 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial191", "name": "osd_memory_target"}]: dispatch 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:57:54.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:54 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;trial190:10.20.193.190=a;trial191:10.20.193.191=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: Saving service mon spec with placement trial190:10.20.193.190=a;trial191:10.20.193.191=b;count:2 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: Updating trial191:/etc/ceph/ceph.conf 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: Updating trial191:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.conf 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: Updating trial191:/etc/ceph/ceph.client.admin.keyring 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: Updating trial191:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: from='client.? 10.20.193.191:0/167800933' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:55.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:55.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:57:55.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-26T02:57:55.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:57:55 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:57:55.815 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-26T02:57:55.815 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph mon dump -f json 2026-02-26T02:57:56.035 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.b/config 2026-02-26T02:57:56.412 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:57:56 trial191 ceph-mon[42317]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-26T02:58:01.243 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:58:01.243 INFO:teuthology.orchestra.run.trial191.stdout:{"epoch":2,"fsid":"d7c43448-12be-11f1-9df6-d404e6e7d460","modified":"2026-02-26T02:57:56.236117Z","created":"2026-02-26T02:57:23.059133Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:3300","nonce":0},{"type":"v1","addr":"10.20.193.190:6789","nonce":0}]},"addr":"10.20.193.190:6789/0","public_addr":"10.20.193.190:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:3300","nonce":0},{"type":"v1","addr":"10.20.193.191:6789","nonce":0}]},"addr":"10.20.193.191:6789/0","public_addr":"10.20.193.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-26T02:58:01.243 INFO:teuthology.orchestra.run.trial191.stderr:dumped monmap epoch 2 2026-02-26T02:58:01.383 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-26T02:58:01.384 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-26T02:58:01.512 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: mon.a calling monitor election 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='client.? 10.20.193.191:0/2588624480' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: mon.b calling monitor election 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.513 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: monmap epoch 2 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: fsid d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: last_changed 2026-02-26T02:57:56.236117+0000 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: created 2026-02-26T02:57:23.059133+0000 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: min_mon_release 19 (squid) 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: election_strategy: 1 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: 0: [v2:10.20.193.190:3300/0,v1:10.20.193.190:6789/0] mon.a 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: 1: [v2:10.20.193.191:3300/0,v1:10.20.193.191:6789/0] mon.b 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: fsmap 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: osdmap e4: 0 total, 0 up, 0 in 2026-02-26T02:58:01.514 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: mgrmap e13: a(active, since 15s) 2026-02-26T02:58:01.515 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: overall HEALTH_OK 2026-02-26T02:58:01.515 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:01.515 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:01.515 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:01 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:01.528 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:01.551 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-26T02:58:01.551 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.551 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: mon.a calling monitor election 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='client.? 10.20.193.191:0/2588624480' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: mon.b calling monitor election 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: monmap epoch 2 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: fsid d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: last_changed 2026-02-26T02:57:56.236117+0000 2026-02-26T02:58:01.552 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: created 2026-02-26T02:57:23.059133+0000 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: min_mon_release 19 (squid) 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: election_strategy: 1 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: 0: [v2:10.20.193.190:3300/0,v1:10.20.193.190:6789/0] mon.a 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: 1: [v2:10.20.193.191:3300/0,v1:10.20.193.191:6789/0] mon.b 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: fsmap 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: osdmap e4: 0 total, 0 up, 0 in 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: mgrmap e13: a(active, since 15s) 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: overall HEALTH_OK 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:01.553 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:01 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:01.740 INFO:teuthology.orchestra.run.trial190.stdout:# minimal ceph.conf for d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:01.741 INFO:teuthology.orchestra.run.trial190.stdout:[global] 2026-02-26T02:58:01.741 INFO:teuthology.orchestra.run.trial190.stdout: fsid = d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:01.741 INFO:teuthology.orchestra.run.trial190.stdout: mon_host = [v2:10.20.193.190:3300/0,v1:10.20.193.190:6789/0] [v2:10.20.193.191:3300/0,v1:10.20.193.191:6789/0] 2026-02-26T02:58:01.880 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-26T02:58:01.880 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:58:01.880 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/etc/ceph/ceph.conf 2026-02-26T02:58:01.906 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:58:01.906 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-26T02:58:01.970 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:58:01.970 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/etc/ceph/ceph.conf 2026-02-26T02:58:01.999 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:58:01.999 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-26T02:58:02.062 INFO:tasks.cephadm:Adding mgr.a on trial190 2026-02-26T02:58:02.063 INFO:tasks.cephadm:Adding mgr.b on trial191 2026-02-26T02:58:02.063 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph orch apply mgr '2;trial190=a;trial191=b' 2026-02-26T02:58:02.247 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.b/config 2026-02-26T02:58:02.485 INFO:teuthology.orchestra.run.trial191.stdout:Scheduled mgr update... 2026-02-26T02:58:02.625 DEBUG:teuthology.orchestra.run.trial191:mgr.b> sudo journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.b.service 2026-02-26T02:58:02.628 INFO:tasks.cephadm:Deploying OSDs... 2026-02-26T02:58:02.628 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:58:02.628 DEBUG:teuthology.orchestra.run.trial190:> dd if=/scratch_devs of=/dev/stdout 2026-02-26T02:58:02.646 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-26T02:58:02.647 DEBUG:teuthology.orchestra.run.trial190:> stat /dev/vg_nvme/lv_1 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout:Access: 2026-02-26 02:57:49.031592833 +0000 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout:Modify: 2026-02-26 02:55:29.594412112 +0000 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout:Change: 2026-02-26 02:55:29.594412112 +0000 2026-02-26T02:58:02.703 INFO:teuthology.orchestra.run.trial190.stdout: Birth: 2026-02-26 02:55:29.594412112 +0000 2026-02-26T02:58:02.703 DEBUG:teuthology.orchestra.run.trial190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-26T02:58:02.768 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records in 2026-02-26T02:58:02.768 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records out 2026-02-26T02:58:02.768 INFO:teuthology.orchestra.run.trial190.stderr:512 bytes copied, 0.000151784 s, 3.4 MB/s 2026-02-26T02:58:02.769 DEBUG:teuthology.orchestra.run.trial190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-26T02:58:02.826 DEBUG:teuthology.orchestra.run.trial190:> stat /dev/vg_nvme/lv_2 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: Updating trial190:/etc/ceph/ceph.conf 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: Updating trial191:/etc/ceph/ceph.conf 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/4014332157' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.829 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.830 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:02 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.882 INFO:teuthology.orchestra.run.trial190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-26T02:58:02.882 INFO:teuthology.orchestra.run.trial190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:02.882 INFO:teuthology.orchestra.run.trial190.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-26T02:58:02.882 INFO:teuthology.orchestra.run.trial190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:02.882 INFO:teuthology.orchestra.run.trial190.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:02.882 INFO:teuthology.orchestra.run.trial190.stdout:Access: 2026-02-26 02:57:49.031592833 +0000 2026-02-26T02:58:02.883 INFO:teuthology.orchestra.run.trial190.stdout:Modify: 2026-02-26 02:55:29.594412112 +0000 2026-02-26T02:58:02.883 INFO:teuthology.orchestra.run.trial190.stdout:Change: 2026-02-26 02:55:29.594412112 +0000 2026-02-26T02:58:02.883 INFO:teuthology.orchestra.run.trial190.stdout: Birth: 2026-02-26 02:55:29.594412112 +0000 2026-02-26T02:58:02.883 DEBUG:teuthology.orchestra.run.trial190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-26T02:58:02.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:02.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: Updating trial190:/etc/ceph/ceph.conf 2026-02-26T02:58:02.944 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: Updating trial191:/etc/ceph/ceph.conf 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/4014332157' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-26T02:58:02.945 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:02.946 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:02 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:02.947 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records in 2026-02-26T02:58:02.948 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records out 2026-02-26T02:58:02.948 INFO:teuthology.orchestra.run.trial190.stderr:512 bytes copied, 0.000152767 s, 3.4 MB/s 2026-02-26T02:58:02.948 DEBUG:teuthology.orchestra.run.trial190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-26T02:58:03.006 DEBUG:teuthology.orchestra.run.trial190:> stat /dev/vg_nvme/lv_3 2026-02-26T02:58:03.061 INFO:teuthology.orchestra.run.trial190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout:Access: 2026-02-26 02:57:49.031592833 +0000 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout:Modify: 2026-02-26 02:55:29.593412119 +0000 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout:Change: 2026-02-26 02:55:29.593412119 +0000 2026-02-26T02:58:03.062 INFO:teuthology.orchestra.run.trial190.stdout: Birth: 2026-02-26 02:55:29.593412119 +0000 2026-02-26T02:58:03.062 DEBUG:teuthology.orchestra.run.trial190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-26T02:58:03.124 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records in 2026-02-26T02:58:03.125 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records out 2026-02-26T02:58:03.125 INFO:teuthology.orchestra.run.trial190.stderr:512 bytes copied, 0.000161793 s, 3.2 MB/s 2026-02-26T02:58:03.126 DEBUG:teuthology.orchestra.run.trial190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-26T02:58:03.183 DEBUG:teuthology.orchestra.run.trial190:> stat /dev/vg_nvme/lv_4 2026-02-26T02:58:03.238 INFO:teuthology.orchestra.run.trial190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout:Access: 2026-02-26 02:57:49.031592833 +0000 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout:Modify: 2026-02-26 02:55:29.593412119 +0000 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout:Change: 2026-02-26 02:55:29.593412119 +0000 2026-02-26T02:58:03.239 INFO:teuthology.orchestra.run.trial190.stdout: Birth: 2026-02-26 02:55:29.593412119 +0000 2026-02-26T02:58:03.239 DEBUG:teuthology.orchestra.run.trial190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-26T02:58:03.301 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records in 2026-02-26T02:58:03.301 INFO:teuthology.orchestra.run.trial190.stderr:1+0 records out 2026-02-26T02:58:03.301 INFO:teuthology.orchestra.run.trial190.stderr:512 bytes copied, 0.000141665 s, 3.6 MB/s 2026-02-26T02:58:03.302 DEBUG:teuthology.orchestra.run.trial190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-26T02:58:03.359 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:58:03.359 DEBUG:teuthology.orchestra.run.trial191:> dd if=/scratch_devs of=/dev/stdout 2026-02-26T02:58:03.375 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-26T02:58:03.375 DEBUG:teuthology.orchestra.run.trial191:> stat /dev/vg_nvme/lv_1 2026-02-26T02:58:03.385 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 podman[43657]: 2026-02-26 02:58:03.384571272 +0000 UTC m=+0.059356156 container init a29c9e24950958bfbfce536e70bf9f8d9c0c1210dd103b4aa66f0ccedb2f0c73 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-26T02:58:03.400 INFO:teuthology.orchestra.run.trial191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-26T02:58:03.400 INFO:teuthology.orchestra.run.trial191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:03.401 INFO:teuthology.orchestra.run.trial191.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-26T02:58:03.401 INFO:teuthology.orchestra.run.trial191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:03.401 INFO:teuthology.orchestra.run.trial191.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:03.401 INFO:teuthology.orchestra.run.trial191.stdout:Access: 2026-02-26 02:58:03.206573979 +0000 2026-02-26T02:58:03.401 INFO:teuthology.orchestra.run.trial191.stdout:Modify: 2026-02-26 02:55:29.202023972 +0000 2026-02-26T02:58:03.401 INFO:teuthology.orchestra.run.trial191.stdout:Change: 2026-02-26 02:55:29.202023972 +0000 2026-02-26T02:58:03.401 INFO:teuthology.orchestra.run.trial191.stdout: Birth: 2026-02-26 02:55:29.202023972 +0000 2026-02-26T02:58:03.401 DEBUG:teuthology.orchestra.run.trial191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-26T02:58:03.467 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records in 2026-02-26T02:58:03.467 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records out 2026-02-26T02:58:03.467 INFO:teuthology.orchestra.run.trial191.stderr:512 bytes copied, 0.000237957 s, 2.2 MB/s 2026-02-26T02:58:03.469 DEBUG:teuthology.orchestra.run.trial191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-26T02:58:03.525 DEBUG:teuthology.orchestra.run.trial191:> stat /dev/vg_nvme/lv_2 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout:Access: 2026-02-26 02:58:03.207573974 +0000 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout:Modify: 2026-02-26 02:55:29.203023968 +0000 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout:Change: 2026-02-26 02:55:29.203023968 +0000 2026-02-26T02:58:03.579 INFO:teuthology.orchestra.run.trial191.stdout: Birth: 2026-02-26 02:55:29.203023968 +0000 2026-02-26T02:58:03.579 DEBUG:teuthology.orchestra.run.trial191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-26T02:58:03.640 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 podman[43657]: 2026-02-26 02:58:03.388401716 +0000 UTC m=+0.063186600 container start a29c9e24950958bfbfce536e70bf9f8d9c0c1210dd103b4aa66f0ccedb2f0c73 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-26T02:58:03.640 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 bash[43657]: a29c9e24950958bfbfce536e70bf9f8d9c0c1210dd103b4aa66f0ccedb2f0c73 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 podman[43657]: 2026-02-26 02:58:03.333953115 +0000 UTC m=+0.008737989 image pull d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 systemd[1]: Started Ceph mgr.b for d7c43448-12be-11f1-9df6-d404e6e7d460. 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mgr[43734]: -- 10.20.193.191:0/417472346 <== mon.0 v2:10.20.193.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a5a2154a0 con 0x559a5a1f3000 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Updating trial190:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.conf 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Updating trial191:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.conf 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Reconfiguring mon.a (unknown last config time)... 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Reconfiguring daemon mon.a on trial190 2026-02-26T02:58:03.641 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Reconfiguring mon.b (monmap changed)... 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Reconfiguring daemon mon.b on trial191 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;trial190=a;trial191=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Saving service mgr spec with placement trial190=a;trial191=b;count:2 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-26T02:58:03.642 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-26T02:58:03.643 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:03.643 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: Deploying daemon mgr.b on trial191 2026-02-26T02:58:03.643 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.643 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.643 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.643 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.643 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:03.644 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records in 2026-02-26T02:58:03.644 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records out 2026-02-26T02:58:03.644 INFO:teuthology.orchestra.run.trial191.stderr:512 bytes copied, 0.000242525 s, 2.1 MB/s 2026-02-26T02:58:03.645 DEBUG:teuthology.orchestra.run.trial191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-26T02:58:03.702 DEBUG:teuthology.orchestra.run.trial191:> stat /dev/vg_nvme/lv_3 2026-02-26T02:58:03.759 INFO:teuthology.orchestra.run.trial191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-26T02:58:03.759 INFO:teuthology.orchestra.run.trial191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:03.759 INFO:teuthology.orchestra.run.trial191.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-26T02:58:03.759 INFO:teuthology.orchestra.run.trial191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:03.759 INFO:teuthology.orchestra.run.trial191.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:03.760 INFO:teuthology.orchestra.run.trial191.stdout:Access: 2026-02-26 02:58:03.207573974 +0000 2026-02-26T02:58:03.760 INFO:teuthology.orchestra.run.trial191.stdout:Modify: 2026-02-26 02:55:29.201023977 +0000 2026-02-26T02:58:03.760 INFO:teuthology.orchestra.run.trial191.stdout:Change: 2026-02-26 02:55:29.201023977 +0000 2026-02-26T02:58:03.760 INFO:teuthology.orchestra.run.trial191.stdout: Birth: 2026-02-26 02:55:29.201023977 +0000 2026-02-26T02:58:03.760 DEBUG:teuthology.orchestra.run.trial191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-26T02:58:03.826 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records in 2026-02-26T02:58:03.826 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records out 2026-02-26T02:58:03.826 INFO:teuthology.orchestra.run.trial191.stderr:512 bytes copied, 0.000239779 s, 2.1 MB/s 2026-02-26T02:58:03.828 DEBUG:teuthology.orchestra.run.trial191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-26T02:58:03.886 DEBUG:teuthology.orchestra.run.trial191:> stat /dev/vg_nvme/lv_4 2026-02-26T02:58:03.912 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:03.793+0000 7f5c27006140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-26T02:58:03.928 INFO:teuthology.orchestra.run.trial191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-26T02:58:03.928 INFO:teuthology.orchestra.run.trial191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:58:03.929 INFO:teuthology.orchestra.run.trial191.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-26T02:58:03.929 INFO:teuthology.orchestra.run.trial191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:58:03.929 INFO:teuthology.orchestra.run.trial191.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:58:03.929 INFO:teuthology.orchestra.run.trial191.stdout:Access: 2026-02-26 02:58:03.207573974 +0000 2026-02-26T02:58:03.929 INFO:teuthology.orchestra.run.trial191.stdout:Modify: 2026-02-26 02:55:29.201023977 +0000 2026-02-26T02:58:03.929 INFO:teuthology.orchestra.run.trial191.stdout:Change: 2026-02-26 02:55:29.201023977 +0000 2026-02-26T02:58:03.929 INFO:teuthology.orchestra.run.trial191.stdout: Birth: 2026-02-26 02:55:29.201023977 +0000 2026-02-26T02:58:03.929 DEBUG:teuthology.orchestra.run.trial191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Updating trial190:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.conf 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Updating trial191:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/config/ceph.conf 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Reconfiguring mon.a (unknown last config time)... 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Reconfiguring daemon mon.a on trial190 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Reconfiguring mon.b (monmap changed)... 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Reconfiguring daemon mon.b on trial191 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;trial190=a;trial191=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:03.978 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Saving service mgr spec with placement trial190=a;trial191=b;count:2 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:03.979 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: Deploying daemon mgr.b on trial191 2026-02-26T02:58:03.980 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.980 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.980 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.980 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:03.980 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:03 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:03.992 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records in 2026-02-26T02:58:03.992 INFO:teuthology.orchestra.run.trial191.stderr:1+0 records out 2026-02-26T02:58:03.992 INFO:teuthology.orchestra.run.trial191.stderr:512 bytes copied, 0.00022916 s, 2.2 MB/s 2026-02-26T02:58:03.993 DEBUG:teuthology.orchestra.run.trial191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-26T02:58:04.050 INFO:tasks.cephadm:Deploying osd.0 on trial190 with /dev/vg_nvme/lv_4... 2026-02-26T02:58:04.050 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-26T02:58:04.208 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:04.221 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:03.942+0000 7f5c27006140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-26T02:58:04.221 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:03 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:03.976+0000 7f5c27006140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-26T02:58:04.221 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.018+0000 7f5c27006140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-26T02:58:04.221 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.049+0000 7f5c27006140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-26T02:58:04.221 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.084+0000 7f5c27006140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-26T02:58:04.221 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.149+0000 7f5c27006140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-26T02:58:04.222 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-26T02:58:04.222 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-26T02:58:04.222 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: from numpy import show_config as show_numpy_config 2026-02-26T02:58:04.481 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.222+0000 7f5c27006140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-26T02:58:04.481 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.257+0000 7f5c27006140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-26T02:58:04.481 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.353+0000 7f5c27006140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-26T02:58:04.481 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.412+0000 7f5c27006140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-26T02:58:04.481 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.446+0000 7f5c27006140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-26T02:58:04.482 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.479+0000 7f5c27006140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-26T02:58:04.786 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.514+0000 7f5c27006140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-26T02:58:04.786 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.544+0000 7f5c27006140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-26T02:58:04.786 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.785+0000 7f5c27006140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-26T02:58:05.041 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.884+0000 7f5c27006140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-26T02:58:05.041 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.915+0000 7f5c27006140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-26T02:58:05.042 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:04.946+0000 7f5c27006140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-26T02:58:05.042 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:05 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:05.039+0000 7f5c27006140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:58:05.042 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.042 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.042 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:05.042 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:05.042 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: Reconfiguring mgr.a (unknown last config time)... 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: Reconfiguring daemon mgr.a on trial190 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:05.043 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:04 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.155 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.155 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.155 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:05.155 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:05.155 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.155 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: Reconfiguring mgr.a (unknown last config time)... 2026-02-26T02:58:05.155 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: Reconfiguring daemon mgr.a on trial190 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:05.156 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:04 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:05.160 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:05.176 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph orch daemon add osd trial190:vg_nvme/lv_4 2026-02-26T02:58:05.323 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:05.412 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:05 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:05.068+0000 7f5c27006140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-26T02:58:05.412 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:05 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:05.160+0000 7f5c27006140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:58:05.911 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:05 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:05.624+0000 7f5c27006140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-26T02:58:05.911 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:05 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:05.654+0000 7f5c27006140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-26T02:58:06.324 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b[43681]: 2026-02-26T02:58:06.054+0000 7f5c27006140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-26T02:58:06.603 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:06.603 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:06.603 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='client.14200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: Standby manager daemon b started 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2026-02-26T02:58:06.604 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:06 trial190 ceph-mon[40625]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-26T02:58:06.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:06.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='client.14200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: Standby manager daemon b started 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2026-02-26T02:58:06.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:06 trial191 ceph-mon[42317]: from='mgr.? 10.20.193.191:0/1473498392' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-26T02:58:07.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:07 trial191 ceph-mon[42317]: mgrmap e14: a(active, since 21s), standbys: b 2026-02-26T02:58:07.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:07 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2026-02-26T02:58:07.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:07 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/144760289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5746a59e-5074-46ed-acf7-1d7d25dd56f3"}]: dispatch 2026-02-26T02:58:07.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:07 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/144760289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5746a59e-5074-46ed-acf7-1d7d25dd56f3"}]': finished 2026-02-26T02:58:07.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:07 trial191 ceph-mon[42317]: osdmap e5: 1 total, 0 up, 1 in 2026-02-26T02:58:07.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:07 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:07.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:07 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/3224482696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-26T02:58:07.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:07 trial190 ceph-mon[40625]: mgrmap e14: a(active, since 21s), standbys: b 2026-02-26T02:58:07.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:07 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2026-02-26T02:58:07.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:07 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/144760289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5746a59e-5074-46ed-acf7-1d7d25dd56f3"}]: dispatch 2026-02-26T02:58:07.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:07 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/144760289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5746a59e-5074-46ed-acf7-1d7d25dd56f3"}]': finished 2026-02-26T02:58:07.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:07 trial190 ceph-mon[40625]: osdmap e5: 1 total, 0 up, 1 in 2026-02-26T02:58:07.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:07 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:07.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:07 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3224482696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-26T02:58:08.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:08 trial191 ceph-mon[42317]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:08.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:08 trial190 ceph-mon[40625]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:10.454 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:10 trial190 ceph-mon[40625]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:10.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:10 trial191 ceph-mon[42317]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:11.549 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:11 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-26T02:58:11.550 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:11 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:11.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:11 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-26T02:58:11.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:11 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:12.600 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:12 trial190 ceph-mon[40625]: Deploying daemon osd.0 on trial190 2026-02-26T02:58:12.600 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:12 trial190 ceph-mon[40625]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:12.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:12 trial191 ceph-mon[42317]: Deploying daemon osd.0 on trial190 2026-02-26T02:58:12.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:12 trial191 ceph-mon[42317]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:13.380 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:13 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:13.380 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:13 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:13.380 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:13 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:13.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:13 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:13.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:13 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:13.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:13 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.330 INFO:teuthology.orchestra.run.trial190.stdout:Created osd(s) 0 on host 'trial190' 2026-02-26T02:58:14.475 DEBUG:teuthology.orchestra.run.trial190:osd.0> sudo journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@osd.0.service 2026-02-26T02:58:14.478 INFO:tasks.cephadm:Deploying osd.1 on trial191 with /dev/vg_nvme/lv_4... 2026-02-26T02:58:14.478 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-26T02:58:14.624 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.b/config 2026-02-26T02:58:14.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:14.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:14.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:14.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:14.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:14 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.809 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:14.809 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.810 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.810 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:14.810 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:14.810 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.810 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:14.810 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:14.810 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:14 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:15.102 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:14 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0[53945]: 2026-02-26T02:58:14.829+0000 7fd550964740 -1 Falling back to public interface 2026-02-26T02:58:15.579 INFO:teuthology.orchestra.run.trial191.stdout: 2026-02-26T02:58:15.594 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph orch daemon add osd trial191:vg_nvme/lv_4 2026-02-26T02:58:15.742 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.b/config 2026-02-26T02:58:16.402 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: Detected new or changed devices on trial190 2026-02-26T02:58:16.402 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.402 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: Adjusting osd_memory_target on trial190 to 84047M 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-26T02:58:16.403 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:16 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:16.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: Detected new or changed devices on trial190 2026-02-26T02:58:16.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: Adjusting osd_memory_target on trial190 to 84047M 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-26T02:58:16.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:16 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: from='client.? 10.20.193.191:0/1232750750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8d99be2-aa3d-4607-9503-d44da6fee0ed"}]: dispatch 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8d99be2-aa3d-4607-9503-d44da6fee0ed"}]: dispatch 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8d99be2-aa3d-4607-9503-d44da6fee0ed"}]': finished 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: osdmap e6: 2 total, 0 up, 2 in 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:17.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:17 trial191 ceph-mon[42317]: from='client.? 10.20.193.191:0/789992494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-26T02:58:17.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:17.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: from='client.? 10.20.193.191:0/1232750750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8d99be2-aa3d-4607-9503-d44da6fee0ed"}]: dispatch 2026-02-26T02:58:17.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8d99be2-aa3d-4607-9503-d44da6fee0ed"}]: dispatch 2026-02-26T02:58:17.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8d99be2-aa3d-4607-9503-d44da6fee0ed"}]': finished 2026-02-26T02:58:17.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: osdmap e6: 2 total, 0 up, 2 in 2026-02-26T02:58:17.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:17.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:17.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:17 trial190 ceph-mon[40625]: from='client.? 10.20.193.191:0/789992494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-26T02:58:18.227 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:17 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0[53945]: 2026-02-26T02:58:17.801+0000 7fd550964740 -1 osd.0 0 log_to_monitors true 2026-02-26T02:58:18.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:18 trial191 ceph-mon[42317]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:18.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:18 trial191 ceph-mon[42317]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-26T02:58:18.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:18 trial190 ceph-mon[40625]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:18.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:18 trial190 ceph-mon[40625]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-26T02:58:19.520 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:19 trial191 ceph-mon[42317]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-26T02:58:19.520 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:19 trial191 ceph-mon[42317]: osdmap e7: 2 total, 0 up, 2 in 2026-02-26T02:58:19.520 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:19 trial191 ceph-mon[42317]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial190", "root=default"]}]: dispatch 2026-02-26T02:58:19.520 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:19 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:19.520 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:19 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:19.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:19 trial190 ceph-mon[40625]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-26T02:58:19.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:19 trial190 ceph-mon[40625]: osdmap e7: 2 total, 0 up, 2 in 2026-02-26T02:58:19.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:19 trial190 ceph-mon[40625]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial190", "root=default"]}]: dispatch 2026-02-26T02:58:19.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:19 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:19.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:19 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:19.728 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:19 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0[53945]: 2026-02-26T02:58:19.429+0000 7fd54c8e5640 -1 osd.0 0 waiting for initial osdmap 2026-02-26T02:58:19.728 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:19 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0[53945]: 2026-02-26T02:58:19.430+0000 7fd544707640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:58:20.384 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:20 trial191 ceph-mon[42317]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial190", "root=default"]}]': finished 2026-02-26T02:58:20.384 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:20 trial191 ceph-mon[42317]: osdmap e8: 2 total, 0 up, 2 in 2026-02-26T02:58:20.385 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:20 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:20.385 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:20 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:20.385 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:20 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:20.385 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:20 trial191 ceph-mon[42317]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:20.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:20 trial190 ceph-mon[40625]: from='osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial190", "root=default"]}]': finished 2026-02-26T02:58:20.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:20 trial190 ceph-mon[40625]: osdmap e8: 2 total, 0 up, 2 in 2026-02-26T02:58:20.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:20 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:20.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:20 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:20.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:20 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:20.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:20 trial190 ceph-mon[40625]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-26T02:58:21.573 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: purged_snaps scrub starts 2026-02-26T02:58:21.573 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: purged_snaps scrub ok 2026-02-26T02:58:21.573 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: OSD bench result of 125924.125677 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-26T02:58:21.573 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:21.573 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046] boot 2026-02-26T02:58:21.573 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: osdmap e9: 2 total, 1 up, 2 in 2026-02-26T02:58:21.573 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:21.574 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:21.574 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-26T02:58:21.574 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:21 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: purged_snaps scrub starts 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: purged_snaps scrub ok 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: OSD bench result of 125924.125677 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: osd.0 [v2:10.20.193.190:6802/731974046,v1:10.20.193.190:6803/731974046] boot 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: osdmap e9: 2 total, 1 up, 2 in 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-26T02:58:21.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:21.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-26T02:58:21.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:21 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:22.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:22 trial191 ceph-mon[42317]: Deploying daemon osd.1 on trial191 2026-02-26T02:58:22.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:22 trial191 ceph-mon[42317]: osdmap e10: 2 total, 1 up, 2 in 2026-02-26T02:58:22.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:22 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:22.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:22 trial191 ceph-mon[42317]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:22.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:22 trial190 ceph-mon[40625]: Deploying daemon osd.1 on trial191 2026-02-26T02:58:22.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:22 trial190 ceph-mon[40625]: osdmap e10: 2 total, 1 up, 2 in 2026-02-26T02:58:22.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:22 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:22.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:22 trial190 ceph-mon[40625]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:23.523 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:23 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:23.523 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:23 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:23.523 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:23 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:23.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:23 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:23.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:23 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:23.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:23 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.249 INFO:teuthology.orchestra.run.trial191.stdout:Created osd(s) 1 on host 'trial191' 2026-02-26T02:58:24.390 DEBUG:teuthology.orchestra.run.trial191:osd.1> sudo journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@osd.1.service 2026-02-26T02:58:24.393 INFO:tasks.cephadm:Waiting for 2 OSDs to come up... 2026-02-26T02:58:24.393 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd stat -f json 2026-02-26T02:58:24.542 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:24.621 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: pgmap v19: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:24.621 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.621 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.622 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:24.622 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:24.622 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.622 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:24.622 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.622 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:24 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: pgmap v19: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:24.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:24.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:24.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-26T02:58:24.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.729 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:24 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:24.759 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:24.896 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":10,"num_osds":2,"num_up_osds":1,"osd_up_since":1772074700,"num_in_osds":2,"osd_in_since":1772074696,"num_remapped_pgs":0} 2026-02-26T02:58:25.224 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:24 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1[47204]: 2026-02-26T02:58:24.955+0000 7feff0e62740 -1 Falling back to public interface 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/2424877359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:25.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:25 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2424877359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-26T02:58:25.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:25 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' 2026-02-26T02:58:25.898 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd stat -f json 2026-02-26T02:58:26.045 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:26.257 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:26.398 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":10,"num_osds":2,"num_up_osds":1,"osd_up_since":1772074700,"num_in_osds":2,"osd_in_since":1772074696,"num_remapped_pgs":0} 2026-02-26T02:58:26.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:26 trial190 ceph-mon[40625]: Detected new or changed devices on trial191 2026-02-26T02:58:26.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:26 trial190 ceph-mon[40625]: Adjusting osd_memory_target on trial191 to 84047M 2026-02-26T02:58:26.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:26 trial190 ceph-mon[40625]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:26.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:26 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3967045857' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:26.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:26 trial191 ceph-mon[42317]: Detected new or changed devices on trial191 2026-02-26T02:58:26.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:26 trial191 ceph-mon[42317]: Adjusting osd_memory_target on trial191 to 84047M 2026-02-26T02:58:26.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:26 trial191 ceph-mon[42317]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:26.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:26 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/3967045857' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:27.399 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd stat -f json 2026-02-26T02:58:27.546 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:27.756 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:27.896 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":10,"num_osds":2,"num_up_osds":1,"osd_up_since":1772074700,"num_in_osds":2,"osd_in_since":1772074696,"num_remapped_pgs":0} 2026-02-26T02:58:28.162 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:27 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1[47204]: 2026-02-26T02:58:27.701+0000 7feff0e62740 -1 osd.1 0 log_to_monitors true 2026-02-26T02:58:28.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:28 trial190 ceph-mon[40625]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:28.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:28 trial190 ceph-mon[40625]: from='osd.1 [v2:10.20.193.191:6800/3579666313,v1:10.20.193.191:6801/3579666313]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-26T02:58:28.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:28 trial190 ceph-mon[40625]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-26T02:58:28.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:28 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/1307480915' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:28.897 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd stat -f json 2026-02-26T02:58:28.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:28 trial191 ceph-mon[42317]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:28.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:28 trial191 ceph-mon[42317]: from='osd.1 [v2:10.20.193.191:6800/3579666313,v1:10.20.193.191:6801/3579666313]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-26T02:58:28.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:28 trial191 ceph-mon[42317]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-26T02:58:28.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:28 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/1307480915' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:29.042 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:29.255 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:29.395 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":11,"num_osds":2,"num_up_osds":1,"osd_up_since":1772074700,"num_in_osds":2,"osd_in_since":1772074696,"num_remapped_pgs":0} 2026-02-26T02:58:29.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:29 trial190 ceph-mon[40625]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-26T02:58:29.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:29 trial190 ceph-mon[40625]: osdmap e11: 2 total, 1 up, 2 in 2026-02-26T02:58:29.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:29 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:29.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:29 trial190 ceph-mon[40625]: from='osd.1 [v2:10.20.193.191:6800/3579666313,v1:10.20.193.191:6801/3579666313]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial191", "root=default"]}]: dispatch 2026-02-26T02:58:29.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:29 trial190 ceph-mon[40625]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial191", "root=default"]}]: dispatch 2026-02-26T02:58:29.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:29 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/1663618556' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:29.912 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:29 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1[47204]: 2026-02-26T02:58:29.619+0000 7fefecde3640 -1 osd.1 0 waiting for initial osdmap 2026-02-26T02:58:29.912 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:29 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1[47204]: 2026-02-26T02:58:29.621+0000 7fefe4c05640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:58:29.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:29 trial191 ceph-mon[42317]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-26T02:58:29.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:29 trial191 ceph-mon[42317]: osdmap e11: 2 total, 1 up, 2 in 2026-02-26T02:58:29.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:29 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:29.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:29 trial191 ceph-mon[42317]: from='osd.1 [v2:10.20.193.191:6800/3579666313,v1:10.20.193.191:6801/3579666313]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial191", "root=default"]}]: dispatch 2026-02-26T02:58:29.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:29 trial191 ceph-mon[42317]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial191", "root=default"]}]: dispatch 2026-02-26T02:58:29.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:29 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/1663618556' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:30.396 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd stat -f json 2026-02-26T02:58:30.543 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:30.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:30 trial190 ceph-mon[40625]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:30.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:30 trial190 ceph-mon[40625]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial191", "root=default"]}]': finished 2026-02-26T02:58:30.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:30 trial190 ceph-mon[40625]: osdmap e12: 2 total, 1 up, 2 in 2026-02-26T02:58:30.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:30 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:30.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:30 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:30.758 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:30.897 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":13,"num_osds":2,"num_up_osds":2,"osd_up_since":1772074710,"num_in_osds":2,"osd_in_since":1772074696,"num_remapped_pgs":0} 2026-02-26T02:58:30.898 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd dump --format=json 2026-02-26T02:58:30.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:30 trial191 ceph-mon[42317]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-26T02:58:30.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:30 trial191 ceph-mon[42317]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial191", "root=default"]}]': finished 2026-02-26T02:58:30.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:30 trial191 ceph-mon[42317]: osdmap e12: 2 total, 1 up, 2 in 2026-02-26T02:58:30.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:30 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:30.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:30 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:31.045 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:31.253 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:31.253 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":13,"fsid":"d7c43448-12be-11f1-9df6-d404e6e7d460","created":"2026-02-26T02:57:24.245177+0000","modified":"2026-02-26T02:58:30.449186+0000","last_up_change":"2026-02-26T02:58:30.449186+0000","last_in_change":"2026-02-26T02:58:16.769606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5746a59e-5074-46ed-acf7-1d7d25dd56f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6802","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6803","nonce":731974046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6804","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6805","nonce":731974046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6808","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6809","nonce":731974046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6806","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6807","nonce":731974046}]},"public_addr":"10.20.193.190:6803/731974046","cluster_addr":"10.20.193.190:6805/731974046","heartbeat_back_addr":"10.20.193.190:6809/731974046","heartbeat_front_addr":"10.20.193.190:6807/731974046","state":["exists","up"]},{"osd":1,"uuid":"b8d99be2-aa3d-4607-9503-d44da6fee0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6800","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6801","nonce":3579666313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6802","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6803","nonce":3579666313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6806","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6807","nonce":3579666313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6804","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6805","nonce":3579666313}]},"public_addr":"10.20.193.191:6801/3579666313","cluster_addr":"10.20.193.191:6803/3579666313","heartbeat_back_addr":"10.20.193.191:6807/3579666313","heartbeat_front_addr":"10.20.193.191:6805/3579666313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:58:18.791104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.190:0/1522044605":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/2035562588":"2026-02-27T02:57:45.296002+0000","10.20.193.190:6800/3332796435":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/1182111233":"2026-02-27T02:57:45.296002+0000","10.20.193.190:6801/3332796435":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/1632890841":"2026-02-27T02:57:35.211657+0000","10.20.193.190:6800/2265756823":"2026-02-27T02:57:35.211657+0000","10.20.193.190:0/139948419":"2026-02-27T02:57:35.211657+0000","10.20.193.190:6801/2265756823":"2026-02-27T02:57:35.211657+0000","10.20.193.190:0/226931562":"2026-02-27T02:57:35.211657+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:58:31.392 INFO:tasks.cephadm.ceph_manager.ceph:[] 2026-02-26T02:58:31.392 INFO:tasks.cephadm:Setting up client nodes... 2026-02-26T02:58:31.393 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-26T02:58:31.538 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: purged_snaps scrub starts 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: purged_snaps scrub ok 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: OSD bench result of 125438.533112 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: osd.1 [v2:10.20.193.191:6800/3579666313,v1:10.20.193.191:6801/3579666313] boot 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: osdmap e13: 2 total, 2 up, 2 in 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/874943008' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:31.622 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:31 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/107300249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-26T02:58:31.795 INFO:teuthology.orchestra.run.trial190.stdout:[client.0] 2026-02-26T02:58:31.795 INFO:teuthology.orchestra.run.trial190.stdout: key = AQDXtp9p+15XLxAAB10aVfA4O+Fi5ki8iqAk6Q== 2026-02-26T02:58:31.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: purged_snaps scrub starts 2026-02-26T02:58:31.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: purged_snaps scrub ok 2026-02-26T02:58:31.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: OSD bench result of 125438.533112 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-26T02:58:31.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: osd.1 [v2:10.20.193.191:6800/3579666313,v1:10.20.193.191:6801/3579666313] boot 2026-02-26T02:58:31.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: osdmap e13: 2 total, 2 up, 2 in 2026-02-26T02:58:31.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: from='mgr.14150 10.20.193.190:0/2673027904' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-26T02:58:31.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/874943008' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-26T02:58:31.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:31 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/107300249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-26T02:58:31.934 DEBUG:teuthology.orchestra.run.trial190:> set -ex 2026-02-26T02:58:31.934 DEBUG:teuthology.orchestra.run.trial190:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-26T02:58:31.934 DEBUG:teuthology.orchestra.run.trial190:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-26T02:58:31.969 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-26T02:58:32.122 INFO:teuthology.orchestra.run.trial191.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.b/config 2026-02-26T02:58:32.369 INFO:teuthology.orchestra.run.trial191.stdout:[client.1] 2026-02-26T02:58:32.370 INFO:teuthology.orchestra.run.trial191.stdout: key = AQDYtp9pguHYFRAAMz2NXPGHmIUEXhIvKKzfnQ== 2026-02-26T02:58:32.508 DEBUG:teuthology.orchestra.run.trial191:> set -ex 2026-02-26T02:58:32.508 DEBUG:teuthology.orchestra.run.trial191:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-26T02:58:32.508 DEBUG:teuthology.orchestra.run.trial191:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-26T02:58:32.543 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-26T02:58:32.543 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-26T02:58:32.544 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-26T02:58:32.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:32 trial191 ceph-mon[42317]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:32.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:32 trial191 ceph-mon[42317]: osdmap e14: 2 total, 2 up, 2 in 2026-02-26T02:58:32.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:32 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/3389372568' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-26T02:58:32.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:32 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/3389372568' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-26T02:58:32.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:32 trial191 ceph-mon[42317]: from='client.? 10.20.193.191:0/4106320485' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-26T02:58:32.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:32 trial191 ceph-mon[42317]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-26T02:58:32.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:32 trial191 ceph-mon[42317]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-26T02:58:32.691 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:32.711 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:32 trial190 ceph-mon[40625]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:32.711 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:32 trial190 ceph-mon[40625]: osdmap e14: 2 total, 2 up, 2 in 2026-02-26T02:58:32.711 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:32 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3389372568' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-26T02:58:32.711 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:32 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3389372568' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-26T02:58:32.711 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:32 trial190 ceph-mon[40625]: from='client.? 10.20.193.191:0/4106320485' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-26T02:58:32.711 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:32 trial190 ceph-mon[40625]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-26T02:58:32.712 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:32 trial190 ceph-mon[40625]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-26T02:58:32.923 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:33.062 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":14,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6800","nonce":4254851018},{"type":"v1","addr":"10.20.193.190:6801","nonce":4254851018}]},"active_addr":"10.20.193.190:6801/4254851018","active_change":"2026-02-26T02:57:45.296091+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14196,"name":"b","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.190:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.190:0","nonce":4078921090}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.190:0","nonce":3071273303}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.190:0","nonce":3251867366}]}]} 2026-02-26T02:58:33.067 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-26T02:58:33.067 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-26T02:58:33.067 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd dump --format=json 2026-02-26T02:58:33.212 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:33.419 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:33.419 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":14,"fsid":"d7c43448-12be-11f1-9df6-d404e6e7d460","created":"2026-02-26T02:57:24.245177+0000","modified":"2026-02-26T02:58:31.453291+0000","last_up_change":"2026-02-26T02:58:30.449186+0000","last_in_change":"2026-02-26T02:58:16.769606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5746a59e-5074-46ed-acf7-1d7d25dd56f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6802","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6803","nonce":731974046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6804","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6805","nonce":731974046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6808","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6809","nonce":731974046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6806","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6807","nonce":731974046}]},"public_addr":"10.20.193.190:6803/731974046","cluster_addr":"10.20.193.190:6805/731974046","heartbeat_back_addr":"10.20.193.190:6809/731974046","heartbeat_front_addr":"10.20.193.190:6807/731974046","state":["exists","up"]},{"osd":1,"uuid":"b8d99be2-aa3d-4607-9503-d44da6fee0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6800","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6801","nonce":3579666313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6802","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6803","nonce":3579666313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6806","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6807","nonce":3579666313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6804","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6805","nonce":3579666313}]},"public_addr":"10.20.193.191:6801/3579666313","cluster_addr":"10.20.193.191:6803/3579666313","heartbeat_back_addr":"10.20.193.191:6807/3579666313","heartbeat_front_addr":"10.20.193.191:6805/3579666313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:58:18.791104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:58:28.678888+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.190:0/1522044605":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/2035562588":"2026-02-27T02:57:45.296002+0000","10.20.193.190:6800/3332796435":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/1182111233":"2026-02-27T02:57:45.296002+0000","10.20.193.190:6801/3332796435":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/1632890841":"2026-02-27T02:57:35.211657+0000","10.20.193.190:6800/2265756823":"2026-02-27T02:57:35.211657+0000","10.20.193.190:0/139948419":"2026-02-27T02:57:35.211657+0000","10.20.193.190:6801/2265756823":"2026-02-27T02:57:35.211657+0000","10.20.193.190:0/226931562":"2026-02-27T02:57:35.211657+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:58:33.537 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:33 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/154594926' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-26T02:58:33.537 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:33 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/1812858208' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-26T02:58:33.558 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-26T02:58:33.558 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd dump --format=json 2026-02-26T02:58:33.702 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:33.905 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:33.905 INFO:teuthology.orchestra.run.trial190.stdout:{"epoch":14,"fsid":"d7c43448-12be-11f1-9df6-d404e6e7d460","created":"2026-02-26T02:57:24.245177+0000","modified":"2026-02-26T02:58:31.453291+0000","last_up_change":"2026-02-26T02:58:30.449186+0000","last_in_change":"2026-02-26T02:58:16.769606+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5746a59e-5074-46ed-acf7-1d7d25dd56f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6802","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6803","nonce":731974046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6804","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6805","nonce":731974046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6808","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6809","nonce":731974046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.190:6806","nonce":731974046},{"type":"v1","addr":"10.20.193.190:6807","nonce":731974046}]},"public_addr":"10.20.193.190:6803/731974046","cluster_addr":"10.20.193.190:6805/731974046","heartbeat_back_addr":"10.20.193.190:6809/731974046","heartbeat_front_addr":"10.20.193.190:6807/731974046","state":["exists","up"]},{"osd":1,"uuid":"b8d99be2-aa3d-4607-9503-d44da6fee0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6800","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6801","nonce":3579666313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6802","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6803","nonce":3579666313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6806","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6807","nonce":3579666313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.191:6804","nonce":3579666313},{"type":"v1","addr":"10.20.193.191:6805","nonce":3579666313}]},"public_addr":"10.20.193.191:6801/3579666313","cluster_addr":"10.20.193.191:6803/3579666313","heartbeat_back_addr":"10.20.193.191:6807/3579666313","heartbeat_front_addr":"10.20.193.191:6805/3579666313","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:58:18.791104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:58:28.678888+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.190:0/1522044605":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/2035562588":"2026-02-27T02:57:45.296002+0000","10.20.193.190:6800/3332796435":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/1182111233":"2026-02-27T02:57:45.296002+0000","10.20.193.190:6801/3332796435":"2026-02-27T02:57:45.296002+0000","10.20.193.190:0/1632890841":"2026-02-27T02:57:35.211657+0000","10.20.193.190:6800/2265756823":"2026-02-27T02:57:35.211657+0000","10.20.193.190:0/139948419":"2026-02-27T02:57:35.211657+0000","10.20.193.190:6801/2265756823":"2026-02-27T02:57:35.211657+0000","10.20.193.190:0/226931562":"2026-02-27T02:57:35.211657+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:58:33.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:33 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/154594926' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-26T02:58:33.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:33 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/1812858208' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-26T02:58:34.044 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-26T02:58:34.044 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-26T02:58:34.191 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:34.192 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:34.477 INFO:teuthology.orchestra.run.trial190.stdout:55834574851 2026-02-26T02:58:34.478 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-26T02:58:34.479 INFO:teuthology.orchestra.run.trial190.stdout:38654705669 2026-02-26T02:58:34.479 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-26T02:58:34.669 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:34.670 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:34.690 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:34 trial190 ceph-mon[40625]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:34.690 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:34 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3884479346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-26T02:58:34.881 INFO:teuthology.orchestra.run.trial190.stdout:38654705668 2026-02-26T02:58:34.884 INFO:teuthology.orchestra.run.trial190.stdout:55834574850 2026-02-26T02:58:34.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:34 trial191 ceph-mon[42317]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:34.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:34 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/3884479346' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-26T02:58:35.023 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2026-02-26T02:58:35.024 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2026-02-26T02:58:35.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:35 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/1751396054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-26T02:58:35.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:35 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2637737792' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-26T02:58:35.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:35 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/1751396054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-26T02:58:35.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:35 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/2637737792' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-26T02:58:36.024 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-26T02:58:36.025 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-26T02:58:36.172 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:36.173 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:36.384 INFO:teuthology.orchestra.run.trial190.stdout:55834574851 2026-02-26T02:58:36.389 INFO:teuthology.orchestra.run.trial190.stdout:38654705669 2026-02-26T02:58:36.522 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2026-02-26T02:58:36.522 DEBUG:teuthology.parallel:result is None 2026-02-26T02:58:36.528 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2026-02-26T02:58:36.528 DEBUG:teuthology.parallel:result is None 2026-02-26T02:58:36.528 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-26T02:58:36.528 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph pg dump --format=json 2026-02-26T02:58:36.712 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:36.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:36 trial190 ceph-mon[40625]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:36.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:36 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/3131302674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-26T02:58:36.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:36 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/817969507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-26T02:58:36.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:36 trial191 ceph-mon[42317]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:36.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:36 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/3131302674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-26T02:58:36.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:36 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/817969507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-26T02:58:36.916 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:36.916 INFO:teuthology.orchestra.run.trial190.stderr:dumped all 2026-02-26T02:58:37.056 INFO:teuthology.orchestra.run.trial190.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2026-02-26T02:58:35.303379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":1468006400,"kb_used":54188,"kb_used_data":240,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":1467952212,"statfs":{"total":1503238553600,"available":1503183065088,"internally_reserved":0,"allocated":245760,"data_stored":60318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27092,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976108,"statfs":{"total":751619276800,"available":751591534592,"internally_reserved":0,"allocated":122880,"data_stored":30159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27096,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976104,"statfs":{"total":751619276800,"available":751591530496,"internally_reserved":0,"allocated":122880,"data_stored":30159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-26T02:58:37.056 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph pg dump --format=json 2026-02-26T02:58:37.202 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:37.413 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:37.413 INFO:teuthology.orchestra.run.trial190.stderr:dumped all 2026-02-26T02:58:37.552 INFO:teuthology.orchestra.run.trial190.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2026-02-26T02:58:37.303636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":1468006400,"kb_used":54188,"kb_used_data":240,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":1467952212,"statfs":{"total":1503238553600,"available":1503183065088,"internally_reserved":0,"allocated":245760,"data_stored":60318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27092,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976108,"statfs":{"total":751619276800,"available":751591534592,"internally_reserved":0,"allocated":122880,"data_stored":30159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27096,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976104,"statfs":{"total":751619276800,"available":751591530496,"internally_reserved":0,"allocated":122880,"data_stored":30159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-26T02:58:37.552 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-26T02:58:37.553 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-26T02:58:37.553 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-26T02:58:37.553 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph health --format=json 2026-02-26T02:58:37.698 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:37.919 INFO:teuthology.orchestra.run.trial190.stdout: 2026-02-26T02:58:37.919 INFO:teuthology.orchestra.run.trial190.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-26T02:58:38.058 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-26T02:58:38.058 INFO:tasks.cephadm:Setup complete, yielding 2026-02-26T02:58:38.059 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-26T02:58:38.073 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial190.front.sepia.ceph.com 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- bash -c 'set -ex 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> HOSTNAMES=$(ceph orch host ls --format json | jq -r '"'"'.[] | .hostname'"'"') 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> for host in $HOSTNAMES; do 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> # do a check-host on each host to make sure it'"'"'s reachable 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> ceph cephadm check-host ${host} 2> ${host}-ok.txt 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> HOST_OK=$(cat ${host}-ok.txt) 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> if ! grep -q "Host looks OK" <<< "$HOST_OK"; then 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> printf "Failed host check:\n\n$HOST_OK" 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> exit 1 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> fi 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> done 2026-02-26T02:58:38.074 DEBUG:teuthology.orchestra.run.trial190:> ' 2026-02-26T02:58:38.219 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:38.296 INFO:teuthology.orchestra.run.trial190.stderr:++ ceph orch host ls --format json 2026-02-26T02:58:38.296 INFO:teuthology.orchestra.run.trial190.stderr:++ jq -r '.[] | .hostname' 2026-02-26T02:58:38.438 INFO:teuthology.orchestra.run.trial190.stderr:+ HOSTNAMES='trial190 2026-02-26T02:58:38.438 INFO:teuthology.orchestra.run.trial190.stderr:trial191' 2026-02-26T02:58:38.438 INFO:teuthology.orchestra.run.trial190.stderr:+ for host in $HOSTNAMES 2026-02-26T02:58:38.438 INFO:teuthology.orchestra.run.trial190.stderr:+ ceph cephadm check-host trial190 2026-02-26T02:58:38.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:38 trial190 ceph-mon[40625]: from='client.14296 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-26T02:58:38.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:38 trial190 ceph-mon[40625]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:38.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:38 trial190 ceph-mon[40625]: from='client.14300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-26T02:58:38.727 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:38 trial190 ceph-mon[40625]: from='client.? 10.20.193.190:0/2129239407' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-26T02:58:38.731 INFO:teuthology.orchestra.run.trial190.stdout:trial190 (None) ok 2026-02-26T02:58:38.740 INFO:teuthology.orchestra.run.trial190.stderr:++ cat trial190-ok.txt 2026-02-26T02:58:38.741 INFO:teuthology.orchestra.run.trial190.stderr:+ HOST_OK='podman (/usr/bin/podman) version 5.8.0 is present 2026-02-26T02:58:38.741 INFO:teuthology.orchestra.run.trial190.stderr:systemctl is present 2026-02-26T02:58:38.741 INFO:teuthology.orchestra.run.trial190.stderr:lvcreate is present 2026-02-26T02:58:38.741 INFO:teuthology.orchestra.run.trial190.stderr:Unit chronyd.service is enabled and running 2026-02-26T02:58:38.741 INFO:teuthology.orchestra.run.trial190.stderr:Hostname "trial190" matches what is expected. 2026-02-26T02:58:38.742 INFO:teuthology.orchestra.run.trial190.stderr:Host looks OK' 2026-02-26T02:58:38.742 INFO:teuthology.orchestra.run.trial190.stderr:+ grep -q 'Host looks OK' 2026-02-26T02:58:38.742 INFO:teuthology.orchestra.run.trial190.stderr:+ for host in $HOSTNAMES 2026-02-26T02:58:38.742 INFO:teuthology.orchestra.run.trial190.stderr:+ ceph cephadm check-host trial191 2026-02-26T02:58:38.911 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:38 trial191 ceph-mon[42317]: from='client.14296 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-26T02:58:38.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:38 trial191 ceph-mon[42317]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-26T02:58:38.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:38 trial191 ceph-mon[42317]: from='client.14300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-26T02:58:38.912 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:38 trial191 ceph-mon[42317]: from='client.? 10.20.193.190:0/2129239407' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-26T02:58:39.036 INFO:teuthology.orchestra.run.trial190.stdout:trial191 (None) ok 2026-02-26T02:58:39.046 INFO:teuthology.orchestra.run.trial190.stderr:++ cat trial191-ok.txt 2026-02-26T02:58:39.047 INFO:teuthology.orchestra.run.trial190.stderr:+ HOST_OK='podman (/usr/bin/podman) version 5.8.0 is present 2026-02-26T02:58:39.047 INFO:teuthology.orchestra.run.trial190.stderr:systemctl is present 2026-02-26T02:58:39.047 INFO:teuthology.orchestra.run.trial190.stderr:lvcreate is present 2026-02-26T02:58:39.047 INFO:teuthology.orchestra.run.trial190.stderr:Unit chronyd.service is enabled and running 2026-02-26T02:58:39.047 INFO:teuthology.orchestra.run.trial190.stderr:Hostname "trial191" matches what is expected. 2026-02-26T02:58:39.048 INFO:teuthology.orchestra.run.trial190.stderr:Host looks OK' 2026-02-26T02:58:39.048 INFO:teuthology.orchestra.run.trial190.stderr:+ grep -q 'Host looks OK' 2026-02-26T02:58:39.181 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-26T02:58:39.192 INFO:tasks.cephadm:Teardown begin 2026-02-26T02:58:39.193 DEBUG:teuthology.orchestra.run.trial190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-26T02:58:39.219 DEBUG:teuthology.orchestra.run.trial191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-26T02:58:39.247 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-26T02:58:39.247 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-26T02:58:39.400 INFO:teuthology.orchestra.run.trial190.stderr:Inferring config /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/mon.a/config 2026-02-26T02:58:39.416 INFO:teuthology.orchestra.run.trial190.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-26T02:58:39.431 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-26T02:58:39.432 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-26T02:58:39.433 DEBUG:teuthology.orchestra.run.trial190:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-26T02:58:39.449 DEBUG:teuthology.orchestra.run.trial191:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-26T02:58:39.466 INFO:tasks.cephadm:Stopping all daemons... 2026-02-26T02:58:39.466 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-26T02:58:39.466 DEBUG:teuthology.orchestra.run.trial190:> sudo systemctl stop ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a 2026-02-26T02:58:39.661 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:39 trial191 ceph-mon[42317]: from='client.14308 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-26T02:58:39.662 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:39 trial191 ceph-mon[42317]: from='client.14312 -' entity='client.admin' cmd=[{"prefix": "cephadm check-host", "host": "trial190", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:39.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:39 trial190 ceph-mon[40625]: from='client.14308 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-26T02:58:39.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:39 trial190 ceph-mon[40625]: from='client.14312 -' entity='client.admin' cmd=[{"prefix": "cephadm check-host", "host": "trial190", "target": ["mon-mgr", ""]}]: dispatch 2026-02-26T02:58:39.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:39 trial190 systemd[1]: Stopping Ceph mon.a for d7c43448-12be-11f1-9df6-d404e6e7d460... 2026-02-26T02:58:39.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:39 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a[40599]: 2026-02-26T02:58:39.589+0000 7fc1cdbe8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-26T02:58:39.728 INFO:journalctl@ceph.mon.a.trial190.stdout:Feb 26 02:58:39 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-a[40599]: 2026-02-26T02:58:39.589+0000 7fc1cdbe8640 -1 mon.a@0(leader) e2 *** Got Signal Terminated *** 2026-02-26T02:58:40.013 DEBUG:teuthology.orchestra.run.trial190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.a.service' 2026-02-26T02:58:40.073 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-26T02:58:40.073 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-26T02:58:40.073 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2026-02-26T02:58:40.073 DEBUG:teuthology.orchestra.run.trial191:> sudo systemctl stop ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.b 2026-02-26T02:58:40.387 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:40 trial191 systemd[1]: Stopping Ceph mon.b for d7c43448-12be-11f1-9df6-d404e6e7d460... 2026-02-26T02:58:40.388 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:40 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-b[42292]: 2026-02-26T02:58:40.176+0000 7febe769d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-26T02:58:40.388 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:40 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-b[42292]: 2026-02-26T02:58:40.176+0000 7febe769d640 -1 mon.b@1(peon) e2 *** Got Signal Terminated *** 2026-02-26T02:58:40.388 INFO:journalctl@ceph.mon.b.trial191.stdout:Feb 26 02:58:40 trial191 podman[50500]: 2026-02-26 02:58:40.278661044 +0000 UTC m=+0.115431328 container died 0fedd62cff6e3a463496e4f0c09323366c317e1e892326833f473bac788a8c4f (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mon-b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-26T02:58:40.454 DEBUG:teuthology.orchestra.run.trial191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mon.b.service' 2026-02-26T02:58:40.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-26T02:58:40.501 INFO:tasks.cephadm.mon.b:Stopped mon.b 2026-02-26T02:58:40.501 INFO:tasks.cephadm.mgr.a:Stopping mgr.a... 2026-02-26T02:58:40.501 DEBUG:teuthology.orchestra.run.trial190:> sudo systemctl stop ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.a 2026-02-26T02:58:40.798 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:58:40 trial190 systemd[1]: Stopping Ceph mgr.a for d7c43448-12be-11f1-9df6-d404e6e7d460... 2026-02-26T02:58:40.798 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:58:40 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:58:40.598+0000 7fbb2ff11640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-26T02:58:40.798 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:58:40 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a[40923]: 2026-02-26T02:58:40.598+0000 7fbb2ff11640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-26T02:58:40.798 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:58:40 trial190 podman[60663]: 2026-02-26 02:58:40.630513783 +0000 UTC m=+0.044820892 container died 6034a4977b2b61f415111aabd2ea4eb9b7d271596b1d7671702b272acafc6037 (image=quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-26T02:58:40.798 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:58:40 trial190 podman[60663]: 2026-02-26 02:58:40.747120584 +0000 UTC m=+0.161427683 container remove 6034a4977b2b61f415111aabd2ea4eb9b7d271596b1d7671702b272acafc6037 (image=quay.ceph.io/ceph-ci/ceph:8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.build-date=20260223) 2026-02-26T02:58:40.798 INFO:journalctl@ceph.mgr.a.trial190.stdout:Feb 26 02:58:40 trial190 bash[60663]: ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-a 2026-02-26T02:58:40.826 DEBUG:teuthology.orchestra.run.trial190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.a.service' 2026-02-26T02:58:40.876 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-26T02:58:40.876 INFO:tasks.cephadm.mgr.a:Stopped mgr.a 2026-02-26T02:58:40.877 INFO:tasks.cephadm.mgr.b:Stopping mgr.b... 2026-02-26T02:58:40.877 DEBUG:teuthology.orchestra.run.trial191:> sudo systemctl stop ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.b 2026-02-26T02:58:41.162 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:40 trial191 systemd[1]: Stopping Ceph mgr.b for d7c43448-12be-11f1-9df6-d404e6e7d460... 2026-02-26T02:58:41.162 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:41 trial191 podman[50667]: 2026-02-26 02:58:41.002258106 +0000 UTC m=+0.044716369 container died a29c9e24950958bfbfce536e70bf9f8d9c0c1210dd103b4aa66f0ccedb2f0c73 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b, io.buildah.version=1.41.3, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-26T02:58:41.162 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:41 trial191 podman[50667]: 2026-02-26 02:58:41.12019944 +0000 UTC m=+0.162657713 container remove a29c9e24950958bfbfce536e70bf9f8d9c0c1210dd103b4aa66f0ccedb2f0c73 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid) 2026-02-26T02:58:41.162 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:41 trial191 bash[50667]: ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-mgr-b 2026-02-26T02:58:41.162 INFO:journalctl@ceph.mgr.b.trial191.stdout:Feb 26 02:58:41 trial191 systemd[1]: ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.b.service: Main process exited, code=exited, status=143/n/a 2026-02-26T02:58:41.196 DEBUG:teuthology.orchestra.run.trial191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@mgr.b.service' 2026-02-26T02:58:41.237 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-26T02:58:41.237 INFO:tasks.cephadm.mgr.b:Stopped mgr.b 2026-02-26T02:58:41.237 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-26T02:58:41.237 DEBUG:teuthology.orchestra.run.trial190:> sudo systemctl stop ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@osd.0 2026-02-26T02:58:41.727 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:41 trial190 systemd[1]: Stopping Ceph osd.0 for d7c43448-12be-11f1-9df6-d404e6e7d460... 2026-02-26T02:58:41.727 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:41 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0[53945]: 2026-02-26T02:58:41.330+0000 7fd54d8f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-26T02:58:41.728 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:41 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0[53945]: 2026-02-26T02:58:41.330+0000 7fd54d8f9640 -1 osd.0 14 *** Got signal Terminated *** 2026-02-26T02:58:41.728 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:41 trial190 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0[53945]: 2026-02-26T02:58:41.330+0000 7fd54d8f9640 -1 osd.0 14 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-26T02:58:47.104 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:46 trial190 podman[60829]: 2026-02-26 02:58:46.845342529 +0000 UTC m=+5.528720478 container died cf4d9150a907be73a85534ec8e19b0e45e93af78de719a8b0e32d209f050f775 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid) 2026-02-26T02:58:47.104 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:46 trial190 podman[60829]: 2026-02-26 02:58:46.957214664 +0000 UTC m=+5.640592603 container remove cf4d9150a907be73a85534ec8e19b0e45e93af78de719a8b0e32d209f050f775 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-26T02:58:47.104 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:46 trial190 bash[60829]: ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0 2026-02-26T02:58:47.104 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:47 trial190 podman[60969]: 2026-02-26 02:58:47.073440736 +0000 UTC m=+0.015857490 container create 3fac8f1c7de2578da4a7393bb780fbb46874b3ace06cafe23f89a5793c855a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0-deactivate, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, ceph=True, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-26T02:58:47.358 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:47 trial190 podman[60969]: 2026-02-26 02:58:47.11517692 +0000 UTC m=+0.057593684 container init 3fac8f1c7de2578da4a7393bb780fbb46874b3ace06cafe23f89a5793c855a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-26T02:58:47.358 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:47 trial190 podman[60969]: 2026-02-26 02:58:47.118615943 +0000 UTC m=+0.061032697 container start 3fac8f1c7de2578da4a7393bb780fbb46874b3ace06cafe23f89a5793c855a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-26T02:58:47.358 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:47 trial190 podman[60969]: 2026-02-26 02:58:47.119034317 +0000 UTC m=+0.061451071 container attach 3fac8f1c7de2578da4a7393bb780fbb46874b3ace06cafe23f89a5793c855a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0-deactivate, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-26T02:58:47.358 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:47 trial190 podman[60969]: 2026-02-26 02:58:47.06714457 +0000 UTC m=+0.009561334 image pull d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644 2026-02-26T02:58:47.358 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:47 trial190 podman[60969]: 2026-02-26 02:58:47.242493811 +0000 UTC m=+0.184910585 container died 3fac8f1c7de2578da4a7393bb780fbb46874b3ace06cafe23f89a5793c855a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, ceph=True, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.label-schema.vendor=CentOS) 2026-02-26T02:58:47.358 INFO:journalctl@ceph.osd.0.trial190.stdout:Feb 26 02:58:47 trial190 podman[60969]: 2026-02-26 02:58:47.357140836 +0000 UTC m=+0.299557590 container remove 3fac8f1c7de2578da4a7393bb780fbb46874b3ace06cafe23f89a5793c855a39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5) 2026-02-26T02:58:47.387 DEBUG:teuthology.orchestra.run.trial190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@osd.0.service' 2026-02-26T02:58:47.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-26T02:58:47.439 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-26T02:58:47.440 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-26T02:58:47.440 DEBUG:teuthology.orchestra.run.trial191:> sudo systemctl stop ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@osd.1 2026-02-26T02:58:47.911 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:47 trial191 systemd[1]: Stopping Ceph osd.1 for d7c43448-12be-11f1-9df6-d404e6e7d460... 2026-02-26T02:58:47.911 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:47 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1[47204]: 2026-02-26T02:58:47.532+0000 7fefeddf7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-26T02:58:47.911 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:47 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1[47204]: 2026-02-26T02:58:47.532+0000 7fefeddf7640 -1 osd.1 14 *** Got signal Terminated *** 2026-02-26T02:58:47.912 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:47 trial191 ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1[47204]: 2026-02-26T02:58:47.532+0000 7fefeddf7640 -1 osd.1 14 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-26T02:58:53.242 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:52 trial191 podman[50834]: 2026-02-26 02:58:52.986919736 +0000 UTC m=+5.467507998 container died db252f943e23a1b1d65113550ca0e43b0109079384fae5940cda9adb16f32b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223) 2026-02-26T02:58:53.242 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50834]: 2026-02-26 02:58:53.099008675 +0000 UTC m=+5.579596937 container remove db252f943e23a1b1d65113550ca0e43b0109079384fae5940cda9adb16f32b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-26T02:58:53.243 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 bash[50834]: ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1 2026-02-26T02:58:53.243 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50976]: 2026-02-26 02:58:53.213615596 +0000 UTC m=+0.014257880 container create f77276b85645c39896e95079f997dd44e7fcb86feb70fa30e7a8a9608483beb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-26T02:58:53.493 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50976]: 2026-02-26 02:58:53.251709366 +0000 UTC m=+0.052351660 container init f77276b85645c39896e95079f997dd44e7fcb86feb70fa30e7a8a9608483beb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1-deactivate, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, OSD_FLAVOR=default, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223) 2026-02-26T02:58:53.493 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50976]: 2026-02-26 02:58:53.255090807 +0000 UTC m=+0.055733091 container start f77276b85645c39896e95079f997dd44e7fcb86feb70fa30e7a8a9608483beb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.license=GPLv2) 2026-02-26T02:58:53.493 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50976]: 2026-02-26 02:58:53.25550799 +0000 UTC m=+0.056150284 container attach f77276b85645c39896e95079f997dd44e7fcb86feb70fa30e7a8a9608483beb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5) 2026-02-26T02:58:53.493 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50976]: 2026-02-26 02:58:53.207775754 +0000 UTC m=+0.008418048 image pull d3962862b88a5558f25e6dde37f228eb120028d2957d1c7e531247ae7b9e6aae quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644 2026-02-26T02:58:53.493 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50976]: 2026-02-26 02:58:53.3772542 +0000 UTC m=+0.177896494 container died f77276b85645c39896e95079f997dd44e7fcb86feb70fa30e7a8a9608483beb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-26T02:58:53.493 INFO:journalctl@ceph.osd.1.trial191.stdout:Feb 26 02:58:53 trial191 podman[50976]: 2026-02-26 02:58:53.491799325 +0000 UTC m=+0.292441619 container remove f77276b85645c39896e95079f997dd44e7fcb86feb70fa30e7a8a9608483beb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a4df91fbb7065cd6d356e796e129c74d7c37bf40dced6ab86ea5f88abcfdf644, name=ceph-d7c43448-12be-11f1-9df6-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=wip-yuri9-testing-2026-02-25-1600-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-26T02:58:53.520 DEBUG:teuthology.orchestra.run.trial191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d7c43448-12be-11f1-9df6-d404e6e7d460@osd.1.service' 2026-02-26T02:58:53.564 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-26T02:58:53.564 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-26T02:58:53.564 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 --force --keep-logs 2026-02-26T02:58:53.678 INFO:teuthology.orchestra.run.trial190.stdout:Deleting cluster with fsid: d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:54.510 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 --force --keep-logs 2026-02-26T02:58:54.625 INFO:teuthology.orchestra.run.trial191.stdout:Deleting cluster with fsid: d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:55.469 DEBUG:teuthology.orchestra.run.trial190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-26T02:58:55.498 DEBUG:teuthology.orchestra.run.trial191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-26T02:58:55.526 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-26T02:58:55.528 DEBUG:teuthology.misc:Transferring archived files from trial190:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095/remote/trial190/crash 2026-02-26T02:58:55.530 DEBUG:teuthology.orchestra.run.trial190:> sudo tar c -f - -C /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/crash -- . 2026-02-26T02:58:55.562 INFO:teuthology.orchestra.run.trial190.stderr:tar: /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-26T02:58:55.563 INFO:teuthology.orchestra.run.trial190.stderr:tar: Error is not recoverable: exiting now 2026-02-26T02:58:55.565 DEBUG:teuthology.misc:Transferring archived files from trial191:/var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095/remote/trial191/crash 2026-02-26T02:58:55.567 DEBUG:teuthology.orchestra.run.trial191:> sudo tar c -f - -C /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/crash -- . 2026-02-26T02:58:55.591 INFO:teuthology.orchestra.run.trial191.stderr:tar: /var/lib/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-26T02:58:55.591 INFO:teuthology.orchestra.run.trial191.stderr:tar: Error is not recoverable: exiting now 2026-02-26T02:58:55.592 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-26T02:58:55.592 DEBUG:teuthology.orchestra.run.trial190:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-26T02:58:55.630 INFO:tasks.cephadm:Compressing logs... 2026-02-26T02:58:55.630 DEBUG:teuthology.orchestra.run.trial190:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:58:55.672 DEBUG:teuthology.orchestra.run.trial191:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:58:55.693 INFO:teuthology.orchestra.run.trial190.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-26T02:58:55.693 INFO:teuthology.orchestra.run.trial190.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-26T02:58:55.693 INFO:teuthology.orchestra.run.trial190.stderr:gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mon.a.log 2026-02-26T02:58:55.693 INFO:teuthology.orchestra.run.trial190.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-osd.0.log 2026-02-26T02:58:55.693 INFO:teuthology.orchestra.run.trial190.stderr:gzip/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.cephadm.log 2026-02-26T02:58:55.694 INFO:teuthology.orchestra.run.trial190.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mgr.a.log 2026-02-26T02:58:55.694 INFO:teuthology.orchestra.run.trial190.stderr: 90.0% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-26T02:58:55.694 INFO:teuthology.orchestra.run.trial190.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.audit.log 2026-02-26T02:58:55.694 INFO:teuthology.orchestra.run.trial190.stderr: 79.2% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.cephadm.log.gz 2026-02-26T02:58:55.694 INFO:teuthology.orchestra.run.trial190.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mgr.a.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-volume.log 2026-02-26T02:58:55.695 INFO:teuthology.orchestra.run.trial190.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.log 2026-02-26T02:58:55.695 INFO:teuthology.orchestra.run.trial190.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-volume.log: 89.2% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.audit.log.gz 2026-02-26T02:58:55.695 INFO:teuthology.orchestra.run.trial190.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.log: 80.5% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.log.gz 2026-02-26T02:58:55.697 INFO:teuthology.orchestra.run.trial190.stderr: 95.0% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-volume.log.gz 2026-02-26T02:58:55.698 INFO:teuthology.orchestra.run.trial191.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-26T02:58:55.698 INFO:teuthology.orchestra.run.trial191.stderr:: No such file or directory 2026-02-26T02:58:55.698 INFO:teuthology.orchestra.run.trial191.stderr:gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.cephadm.log 2026-02-26T02:58:55.698 INFO:teuthology.orchestra.run.trial191.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mgr.b.log 2026-02-26T02:58:55.698 INFO:teuthology.orchestra.run.trial191.stderr:gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.audit.log 2026-02-26T02:58:55.698 INFO:teuthology.orchestra.run.trial191.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.cephadm.log: 88.5% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-26T02:58:55.699 INFO:teuthology.orchestra.run.trial191.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mgr.b.log: 75.2% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.cephadm.log.gz 2026-02-26T02:58:55.699 INFO:teuthology.orchestra.run.trial191.stderr:gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mon.b.log 2026-02-26T02:58:55.699 INFO:teuthology.orchestra.run.trial191.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-volume.log 2026-02-26T02:58:55.699 INFO:teuthology.orchestra.run.trial191.stderr: 89.4% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.audit.log.gz 2026-02-26T02:58:55.699 INFO:teuthology.orchestra.run.trial191.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-osd.1.log 2026-02-26T02:58:55.699 INFO:teuthology.orchestra.run.trial191.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.log 2026-02-26T02:58:55.700 INFO:teuthology.orchestra.run.trial191.stderr:/var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-osd.1.log: /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.log: 77.7% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph.log.gz 2026-02-26T02:58:55.700 INFO:teuthology.orchestra.run.trial191.stderr: 90.0% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mgr.b.log.gz 2026-02-26T02:58:55.701 INFO:teuthology.orchestra.run.trial190.stderr: 93.9% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-osd.0.log.gz 2026-02-26T02:58:55.702 INFO:teuthology.orchestra.run.trial191.stderr: 94.8% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-volume.log.gz 2026-02-26T02:58:55.706 INFO:teuthology.orchestra.run.trial191.stderr: 93.9% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-osd.1.log.gz 2026-02-26T02:58:55.708 INFO:teuthology.orchestra.run.trial191.stderr: 92.6% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mon.b.log.gz 2026-02-26T02:58:55.709 INFO:teuthology.orchestra.run.trial191.stderr: 2026-02-26T02:58:55.710 INFO:teuthology.orchestra.run.trial191.stderr:real 0m0.020s 2026-02-26T02:58:55.710 INFO:teuthology.orchestra.run.trial191.stderr:user 0m0.028s 2026-02-26T02:58:55.710 INFO:teuthology.orchestra.run.trial191.stderr:sys 0m0.014s 2026-02-26T02:58:55.713 INFO:teuthology.orchestra.run.trial190.stderr: 89.5% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mgr.a.log.gz 2026-02-26T02:58:55.731 INFO:teuthology.orchestra.run.trial190.stderr: 91.5% -- replaced with /var/log/ceph/d7c43448-12be-11f1-9df6-d404e6e7d460/ceph-mon.a.log.gz 2026-02-26T02:58:55.733 INFO:teuthology.orchestra.run.trial190.stderr: 2026-02-26T02:58:55.734 INFO:teuthology.orchestra.run.trial190.stderr:real 0m0.048s 2026-02-26T02:58:55.734 INFO:teuthology.orchestra.run.trial190.stderr:user 0m0.067s 2026-02-26T02:58:55.734 INFO:teuthology.orchestra.run.trial190.stderr:sys 0m0.022s 2026-02-26T02:58:55.734 INFO:tasks.cephadm:Archiving logs... 2026-02-26T02:58:55.735 DEBUG:teuthology.misc:Transferring archived files from trial190:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095/remote/trial190/log 2026-02-26T02:58:55.736 DEBUG:teuthology.orchestra.run.trial190:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-26T02:58:55.824 DEBUG:teuthology.misc:Transferring archived files from trial191:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095/remote/trial191/log 2026-02-26T02:58:55.826 DEBUG:teuthology.orchestra.run.trial191:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-26T02:58:55.862 INFO:tasks.cephadm:Removing cluster... 2026-02-26T02:58:55.862 DEBUG:teuthology.orchestra.run.trial190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 --force 2026-02-26T02:58:55.973 INFO:teuthology.orchestra.run.trial190.stdout:Deleting cluster with fsid: d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:56.156 DEBUG:teuthology.orchestra.run.trial191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d7c43448-12be-11f1-9df6-d404e6e7d460 --force 2026-02-26T02:58:56.269 INFO:teuthology.orchestra.run.trial191.stdout:Deleting cluster with fsid: d7c43448-12be-11f1-9df6-d404e6e7d460 2026-02-26T02:58:56.459 INFO:tasks.cephadm:Removing cephadm ... 2026-02-26T02:58:56.459 DEBUG:teuthology.orchestra.run.trial190:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-26T02:58:56.477 DEBUG:teuthology.orchestra.run.trial191:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-26T02:58:56.493 INFO:tasks.cephadm:Teardown complete 2026-02-26T02:58:56.493 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-26T02:58:56.505 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-26T02:58:56.505 DEBUG:teuthology.orchestra.run.trial190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-26T02:58:56.518 DEBUG:teuthology.orchestra.run.trial191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-26T02:58:56.695 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-26T02:58:56.708 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-26T02:58:56.708 DEBUG:teuthology.orchestra.run.trial190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:58:56.710 DEBUG:teuthology.orchestra.run.trial191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:58:56.724 INFO:teuthology.orchestra.run.trial190.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:58:56.727 INFO:teuthology.orchestra.run.trial191.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:58:57.559 INFO:teuthology.orchestra.run.trial191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:58:57.560 INFO:teuthology.orchestra.run.trial191.stdout:=============================================================================== 2026-02-26T02:58:57.560 INFO:teuthology.orchestra.run.trial191.stdout:^* 68-234-48-70.planet.net 1 6 177 10 +475ns[+7198ns] +/- 2510us 2026-02-26T02:58:57.560 INFO:teuthology.orchestra.run.trial191.stdout:^? tick.chi1.ntfo.org 3 6 2 210 +1073us[ +825us] +/- 127ms 2026-02-26T02:58:57.560 INFO:teuthology.orchestra.run.trial191.stdout:^- dns-e.ns4v.icu 2 6 177 10 +2941us[+2941us] +/- 57ms 2026-02-26T02:58:57.560 INFO:teuthology.orchestra.run.trial191.stdout:^- zap.frizzen.net 3 6 177 11 +89us[ +96us] +/- 50ms 2026-02-26T02:58:57.561 INFO:teuthology.orchestra.run.trial190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:58:57.561 INFO:teuthology.orchestra.run.trial190.stdout:=============================================================================== 2026-02-26T02:58:57.561 INFO:teuthology.orchestra.run.trial190.stdout:^* 68-234-48-70.planet.net 1 6 177 10 +40us[ +122us] +/- 2569us 2026-02-26T02:58:57.561 INFO:teuthology.orchestra.run.trial190.stdout:^? tick.chi1.ntfo.org 3 7 140 208 +985us[+1013us] +/- 127ms 2026-02-26T02:58:57.562 INFO:teuthology.orchestra.run.trial190.stdout:^- dns-e.ns4v.icu 2 6 177 10 +4243us[+4243us] +/- 58ms 2026-02-26T02:58:57.562 INFO:teuthology.orchestra.run.trial190.stdout:^- zap.frizzen.net 3 6 177 9 +925us[ +925us] +/- 49ms 2026-02-26T02:58:57.563 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-26T02:58:57.579 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-26T02:58:57.580 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-26T02:58:57.594 DEBUG:teuthology.orchestra.run.trial190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-26T02:58:57.659 DEBUG:teuthology.orchestra.run.trial191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-26T02:58:57.715 DEBUG:teuthology.orchestra.run.trial190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-26T02:58:57.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:58:57.743 DEBUG:teuthology.orchestra.run.trial191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-26T02:58:57.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:58:57.769 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-26T02:58:57.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-26T02:58:57.793 INFO:teuthology.task.internal:Duration was 385.843539 seconds 2026-02-26T02:58:57.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-26T02:58:57.805 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-26T02:58:57.806 DEBUG:teuthology.orchestra.run.trial190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-26T02:58:57.807 DEBUG:teuthology.orchestra.run.trial191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-26T02:58:57.841 INFO:teuthology.orchestra.run.trial190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:58:57.845 INFO:teuthology.orchestra.run.trial191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:58:58.196 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-26T02:58:58.196 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial190.front.sepia.ceph.com 2026-02-26T02:58:58.197 DEBUG:teuthology.orchestra.run.trial190:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-26T02:58:58.215 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial191.front.sepia.ceph.com 2026-02-26T02:58:58.216 DEBUG:teuthology.orchestra.run.trial191:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-26T02:58:58.255 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-26T02:58:58.256 DEBUG:teuthology.orchestra.run.trial190:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:58:58.258 DEBUG:teuthology.orchestra.run.trial191:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:58:58.367 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-26T02:58:58.367 DEBUG:teuthology.orchestra.run.trial190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:58:58.369 DEBUG:teuthology.orchestra.run.trial191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:58:58.390 INFO:teuthology.orchestra.run.trial190.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:58:58.390 INFO:teuthology.orchestra.run.trial190.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:58:58.390 INFO:teuthology.orchestra.run.trial190.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-26T02:58:58.390 INFO:teuthology.orchestra.run.trial190.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:58:58.390 INFO:teuthology.orchestra.run.trial190.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-26T02:58:58.391 INFO:teuthology.orchestra.run.trial191.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:58:58.391 INFO:teuthology.orchestra.run.trial191.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:58:58.392 INFO:teuthology.orchestra.run.trial191.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-26T02:58:58.392 INFO:teuthology.orchestra.run.trial191.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:58:58.392 INFO:teuthology.orchestra.run.trial191.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-26T02:58:58.405 INFO:teuthology.orchestra.run.trial191.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-26T02:58:58.407 INFO:teuthology.orchestra.run.trial190.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 85.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-26T02:58:58.409 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-26T02:58:58.421 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-26T02:58:58.422 DEBUG:teuthology.orchestra.run.trial190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-26T02:58:58.473 DEBUG:teuthology.orchestra.run.trial191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-26T02:58:58.500 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-26T02:58:58.523 DEBUG:teuthology.orchestra.run.trial190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:58:58.525 DEBUG:teuthology.orchestra.run.trial191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:58:58.548 INFO:teuthology.orchestra.run.trial190.stdout:kernel.core_pattern = core 2026-02-26T02:58:58.563 INFO:teuthology.orchestra.run.trial191.stdout:kernel.core_pattern = core 2026-02-26T02:58:58.581 DEBUG:teuthology.orchestra.run.trial190:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:58:58.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:58:58.621 DEBUG:teuthology.orchestra.run.trial191:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:58:58.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:58:58.636 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-26T02:58:58.649 INFO:teuthology.task.internal:Transferring archived files... 2026-02-26T02:58:58.649 DEBUG:teuthology.misc:Transferring archived files from trial190:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095/remote/trial190 2026-02-26T02:58:58.649 DEBUG:teuthology.orchestra.run.trial190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-26T02:58:58.692 DEBUG:teuthology.misc:Transferring archived files from trial191:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71095/remote/trial191 2026-02-26T02:58:58.693 DEBUG:teuthology.orchestra.run.trial191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-26T02:58:58.729 INFO:teuthology.task.internal:Removing archive directory... 2026-02-26T02:58:58.729 DEBUG:teuthology.orchestra.run.trial190:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-26T02:58:58.731 DEBUG:teuthology.orchestra.run.trial191:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-26T02:58:58.776 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-26T02:58:58.794 INFO:teuthology.task.internal:Not uploading archives. 2026-02-26T02:58:58.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-26T02:58:58.812 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-26T02:58:58.812 DEBUG:teuthology.orchestra.run.trial190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-26T02:58:58.814 DEBUG:teuthology.orchestra.run.trial191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-26T02:58:58.829 INFO:teuthology.orchestra.run.trial190.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 02:58 /home/ubuntu/cephtest 2026-02-26T02:58:58.831 INFO:teuthology.orchestra.run.trial191.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 02:58 /home/ubuntu/cephtest 2026-02-26T02:58:58.832 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-26T02:58:58.844 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-26T02:58:58.870 INFO:teuthology.run:Summary data: description: rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} duration: 385.8435392379761 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-26T02:58:58.870 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T02:58:58.959 INFO:teuthology.run:pass