2026-02-17T00:03:09.815 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-17T00:03:09.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T00:03:09.909 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337 branch: wip-squid-pr-67199-kefu-1 description: orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} email: null first_in_suite: false flavor: default job_id: '50337' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-squid-pr-67199-kefu-1 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - OSD_DOWN - CEPHADM_FAILED_DAEMON - but it is still running - PG_DEGRADED log-only-match: - CEPHADM_ sha1: 05b55d192f002ad5df41409624b8d176527d0841 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 05b55d192f002ad5df41409624b8d176527d0841 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-squid-pr-67199-kefu-1 sha1: 05b55d192f002ad5df41409624b8d176527d0841 owner: scheduled_dgalloway@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - - host.b - client.1 seed: 4155 sha1: 05b55d192f002ad5df41409624b8d176527d0841 sleep_before_teardown: 0 subset: 110/12000 suite: orch:cephadm suite_branch: wip-squid-pr-67199-kefu-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 05b55d192f002ad5df41409624b8d176527d0841 targets: trial151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHoAAosRXDNkVuoA96y0wG7G/JuhfSPlcFrLP9e15W8ssuxQrLOEyF6Im6Uj9AWaD5GQpbOUr96SeWZOA0qpnr8= trial196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxFaMWTzjt1WtzhaUUm1tIvOpezd/iIAyslldTEdfJrq7y2BlHxGmM1oElPt8+ljIIyTNEOXemUaXp30ch5/0w= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - nvme_loop: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - ceph orch ls | grep '^osd.all-available-devices ' - cephadm.shell: host.a: - 'set -e set -x ceph orch ps ceph orch device ls DEVID=$(ceph device ls | grep osd.1 | awk ''{print $1}'') HOST=$(ceph orch device ls | grep $DEVID | awk ''{print $1}'') DEV=$(ceph orch device ls | grep $DEVID | awk ''{print $2}'') echo "host $HOST, dev $DEV, devid $DEVID" ceph orch osd rm 1 while ceph orch osd rm status | grep ^1 ; do sleep 5 ; done ceph orch device zap $HOST $DEV --force ceph orch daemon add osd $HOST:$DEV while ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_23:06:25 tube: trial user: dgalloway verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T00:03:09.909 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa; will attempt to use it 2026-02-17T00:03:09.910 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa/tasks 2026-02-17T00:03:09.910 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T00:03:09.911 INFO:teuthology.task.internal:Checking packages... 2026-02-17T00:03:09.911 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '05b55d192f002ad5df41409624b8d176527d0841' 2026-02-17T00:03:09.912 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T00:03:09.912 INFO:teuthology.packaging:ref: None 2026-02-17T00:03:09.912 INFO:teuthology.packaging:tag: None 2026-02-17T00:03:09.912 INFO:teuthology.packaging:branch: wip-squid-pr-67199-kefu-1 2026-02-17T00:03:09.912 INFO:teuthology.packaging:sha1: 05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:03:09.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-squid-pr-67199-kefu-1 2026-02-17T00:03:10.033 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-680.g05b55d19 2026-02-17T00:03:10.034 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T00:03:10.046 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T00:03:10.046 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T00:03:10.059 INFO:teuthology.task.internal:Saving configuration 2026-02-17T00:03:10.069 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T00:03:10.082 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T00:03:10.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial151.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-16 23:59:39.824631', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHoAAosRXDNkVuoA96y0wG7G/JuhfSPlcFrLP9e15W8ssuxQrLOEyF6Im6Uj9AWaD5GQpbOUr96SeWZOA0qpnr8='} 2026-02-17T00:03:10.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial196.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-16 23:59:39.824009', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxFaMWTzjt1WtzhaUUm1tIvOpezd/iIAyslldTEdfJrq7y2BlHxGmM1oElPt8+ljIIyTNEOXemUaXp30ch5/0w='} 2026-02-17T00:03:10.218 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T00:03:10.229 INFO:teuthology.task.internal:roles: ubuntu@trial151.front.sepia.ceph.com - ['host.a', 'client.0'] 2026-02-17T00:03:10.229 INFO:teuthology.task.internal:roles: ubuntu@trial196.front.sepia.ceph.com - ['host.b', 'client.1'] 2026-02-17T00:03:10.229 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T00:03:10.365 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7bf2903f9940>, signals=[15]) 2026-02-17T00:03:10.365 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T00:03:10.376 INFO:teuthology.task.internal:Opening connections... 2026-02-17T00:03:10.376 DEBUG:teuthology.task.internal:connecting to ubuntu@trial151.front.sepia.ceph.com 2026-02-17T00:03:10.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:03:10.439 DEBUG:teuthology.task.internal:connecting to ubuntu@trial196.front.sepia.ceph.com 2026-02-17T00:03:10.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:03:10.501 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T00:03:10.513 DEBUG:teuthology.orchestra.run.trial151:> uname -m 2026-02-17T00:03:10.528 INFO:teuthology.orchestra.run.trial151.stdout:x86_64 2026-02-17T00:03:10.529 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:NAME="CentOS Stream" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="9" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:ID="centos" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel fedora" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="9" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el9" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;31" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://centos.org/" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T00:03:10.584 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T00:03:10.585 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server 2026-02-17T00:03:10.649 DEBUG:teuthology.orchestra.run.trial196:> uname -m 2026-02-17T00:03:10.664 INFO:teuthology.orchestra.run.trial196.stdout:x86_64 2026-02-17T00:03:10.665 DEBUG:teuthology.orchestra.run.trial196:> cat /etc/os-release 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:NAME="CentOS Stream" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:VERSION="9" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:ID="centos" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:ID_LIKE="rhel fedora" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:VERSION_ID="9" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:PLATFORM_ID="platform:el9" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:ANSI_COLOR="0;31" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:LOGO="fedora-logo-icon" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:HOME_URL="https://centos.org/" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T00:03:10.721 INFO:teuthology.orchestra.run.trial196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T00:03:10.722 INFO:teuthology.lock.ops:Updating trial196.front.sepia.ceph.com on lock server 2026-02-17T00:03:10.795 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T00:03:10.807 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T00:03:10.817 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T00:03:10.817 DEBUG:teuthology.orchestra.run.trial151:> test '!' -e /home/ubuntu/cephtest 2026-02-17T00:03:10.818 DEBUG:teuthology.orchestra.run.trial196:> test '!' -e /home/ubuntu/cephtest 2026-02-17T00:03:10.833 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T00:03:10.843 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T00:03:10.843 DEBUG:teuthology.orchestra.run.trial151:> test -z $(ls -A /var/lib/ceph) 2026-02-17T00:03:10.874 DEBUG:teuthology.orchestra.run.trial196:> test -z $(ls -A /var/lib/ceph) 2026-02-17T00:03:10.891 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T00:03:11.044 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T00:03:11.065 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T00:03:11.066 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T00:03:11.066 DEBUG:teuthology.orchestra.run.trial151:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T00:03:11.066 DEBUG:teuthology.orchestra.run.trial196:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T00:03:11.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:03:11.080 DEBUG:teuthology.orchestra.run.trial151:> uname -r 2026-02-17T00:03:11.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:03:11.081 DEBUG:teuthology.orchestra.run.trial196:> uname -r 2026-02-17T00:03:11.136 INFO:teuthology.orchestra.run.trial151.stdout:5.14.0-645.el9.x86_64 2026-02-17T00:03:11.136 INFO:teuthology.task.kernel:Running kernel on trial151: 5.14.0-645.el9.x86_64 2026-02-17T00:03:11.136 DEBUG:teuthology.orchestra.run.trial151:> sudo yum install -y kernel 2026-02-17T00:03:11.136 INFO:teuthology.orchestra.run.trial196.stdout:5.14.0-645.el9.x86_64 2026-02-17T00:03:11.136 INFO:teuthology.task.kernel:Running kernel on trial196: 5.14.0-645.el9.x86_64 2026-02-17T00:03:11.136 DEBUG:teuthology.orchestra.run.trial196:> sudo yum install -y kernel 2026-02-17T00:03:18.856 INFO:teuthology.orchestra.run.trial151.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.9 MB 00:07 2026-02-17T00:03:23.361 INFO:teuthology.orchestra.run.trial151.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 27 MB 00:03 2026-02-17T00:03:29.903 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - BaseOS 495 kB/s | 8.9 MB 00:18 2026-02-17T00:03:34.516 INFO:teuthology.orchestra.run.trial151.stdout:CentOS Stream 9 - CRB 903 kB/s | 7.8 MB 00:08 2026-02-17T00:03:36.166 INFO:teuthology.orchestra.run.trial151.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-17T00:03:36.863 INFO:teuthology.orchestra.run.trial151.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-02-17T00:03:39.997 INFO:teuthology.orchestra.run.trial151.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T00:03:41.016 INFO:teuthology.orchestra.run.trial151.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T00:03:41.036 INFO:teuthology.orchestra.run.trial151.stdout:Dependencies resolved. 2026-02-17T00:03:41.037 INFO:teuthology.orchestra.run.trial151.stdout:================================================================================ 2026-02-17T00:03:41.037 INFO:teuthology.orchestra.run.trial151.stdout: Package Architecture Version Repository Size 2026-02-17T00:03:41.037 INFO:teuthology.orchestra.run.trial151.stdout:================================================================================ 2026-02-17T00:03:41.037 INFO:teuthology.orchestra.run.trial151.stdout:Installing: 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout:Installing dependencies: 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout:Transaction Summary 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout:================================================================================ 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout:Install 4 Packages 2026-02-17T00:03:41.038 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:03:41.039 INFO:teuthology.orchestra.run.trial151.stdout:Total download size: 88 M 2026-02-17T00:03:41.039 INFO:teuthology.orchestra.run.trial151.stdout:Installed size: 135 M 2026-02-17T00:03:41.039 INFO:teuthology.orchestra.run.trial151.stdout:Downloading Packages: 2026-02-17T00:03:41.761 INFO:teuthology.orchestra.run.trial151.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-17T00:03:42.380 INFO:teuthology.orchestra.run.trial151.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-17T00:03:42.949 INFO:teuthology.orchestra.run.trial151.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 26 MB/s | 31 MB 00:01 2026-02-17T00:03:43.025 INFO:teuthology.orchestra.run.trial151.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T00:03:43.025 INFO:teuthology.orchestra.run.trial151.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:03:43.025 INFO:teuthology.orchestra.run.trial151.stdout:Total 44 MB/s | 88 MB 00:01 2026-02-17T00:03:43.213 INFO:teuthology.orchestra.run.trial151.stdout:Running transaction check 2026-02-17T00:03:43.427 INFO:teuthology.orchestra.run.trial151.stdout:Transaction check succeeded. 2026-02-17T00:03:43.427 INFO:teuthology.orchestra.run.trial151.stdout:Running transaction test 2026-02-17T00:03:43.773 INFO:teuthology.orchestra.run.trial151.stdout:Transaction test succeeded. 2026-02-17T00:03:43.773 INFO:teuthology.orchestra.run.trial151.stdout:Running transaction 2026-02-17T00:03:44.865 INFO:teuthology.orchestra.run.trial151.stdout: Preparing : 1/1 2026-02-17T00:03:45.151 INFO:teuthology.orchestra.run.trial151.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:03:45.171 INFO:teuthology.orchestra.run.trial151.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:03:46.966 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:03:46.995 INFO:teuthology.orchestra.run.trial151.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:03:50.079 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:03:50.084 INFO:teuthology.orchestra.run.trial151.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:03:52.597 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 27 MB 00:22 2026-02-17T00:03:53.185 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:03:55.891 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 7.8 MB 00:00 2026-02-17T00:03:57.652 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-17T00:03:59.279 INFO:teuthology.orchestra.run.trial196.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-17T00:04:02.511 INFO:teuthology.orchestra.run.trial196.stdout:lab-extras 1.2 MB/s | 50 kB 00:00 2026-02-17T00:04:03.535 INFO:teuthology.orchestra.run.trial196.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T00:04:03.555 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-17T00:04:03.556 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-17T00:04:03.556 INFO:teuthology.orchestra.run.trial196.stdout: Package Architecture Version Repository Size 2026-02-17T00:04:03.556 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-17T00:04:03.556 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-17T00:04:03.556 INFO:teuthology.orchestra.run.trial196.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T00:04:03.556 INFO:teuthology.orchestra.run.trial196.stdout:Installing dependencies: 2026-02-17T00:04:03.556 INFO:teuthology.orchestra.run.trial196.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout:Install 4 Packages 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 88 M 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 135 M 2026-02-17T00:04:03.557 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-17T00:04:04.202 INFO:teuthology.orchestra.run.trial196.stdout:[MIRROR] kernel-core-5.14.0-681.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-681.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T00:04:04.210 INFO:teuthology.orchestra.run.trial196.stdout:[MIRROR] kernel-modules-5.14.0-681.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-681.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T00:04:04.211 INFO:teuthology.orchestra.run.trial196.stdout:[MIRROR] kernel-5.14.0-681.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-681.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T00:04:04.561 INFO:teuthology.orchestra.run.trial196.stdout:[MIRROR] kernel-core-5.14.0-681.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-681.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T00:04:04.562 INFO:teuthology.orchestra.run.trial196.stdout:[MIRROR] kernel-modules-5.14.0-681.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-681.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T00:04:04.566 INFO:teuthology.orchestra.run.trial196.stdout:[MIRROR] kernel-5.14.0-681.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-681.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T00:04:04.624 INFO:teuthology.orchestra.run.trial196.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2026-02-17T00:04:04.746 INFO:teuthology.orchestra.run.trial196.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 19 MB/s | 17 MB 00:00 2026-02-17T00:04:05.078 INFO:teuthology.orchestra.run.trial196.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 33 MB/s | 40 MB 00:01 2026-02-17T00:04:23.586 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:04:23.606 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:04:23.776 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:04:23.777 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:04:23.777 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:04:23.777 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout:Installed: 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T00:04:23.828 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:04:23.829 INFO:teuthology.orchestra.run.trial151.stdout:Complete! 2026-02-17T00:04:23.884 DEBUG:teuthology.orchestra.run.trial151:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:04:23.910 INFO:teuthology.orchestra.run.trial151.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:04:23.911 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:04:23.911 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T00:04:23.911 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T00:04:23.911 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T00:04:23.912 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-17T00:04:23.912 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial151.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T00:04:23.912 DEBUG:teuthology.orchestra.run.trial151:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:04:23.974 INFO:teuthology.orchestra.run.trial151.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:04:23.976 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:04:23.976 DEBUG:teuthology.orchestra.run.trial151:> sudo rpm -qi grub2-tools 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Name : grub2-tools 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Epoch : 1 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Version : 2.06 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Release : 118.el9 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Architecture: x86_64 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Group : Unspecified 2026-02-17T00:04:24.046 INFO:teuthology.orchestra.run.trial151.stdout:Size : 8393909 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:License : GPLv3+ 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Packager : builder@centos.org 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Vendor : CentOS 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Summary : Support tools for GRUB. 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:Description : 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:04:24.047 INFO:teuthology.orchestra.run.trial151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T00:04:24.048 INFO:teuthology.orchestra.run.trial151.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T00:04:24.048 INFO:teuthology.orchestra.run.trial151.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T00:04:24.048 INFO:teuthology.orchestra.run.trial151.stdout:hardware devices. 2026-02-17T00:04:24.048 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:04:24.048 INFO:teuthology.orchestra.run.trial151.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T00:04:24.049 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T00:04:24.049 INFO:teuthology.task.kernel:Updating grub on trial151 to boot 5.14.0-681.el9.x86_64 2026-02-17T00:04:24.049 DEBUG:teuthology.orchestra.run.trial151:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T00:04:24.112 INFO:teuthology.orchestra.run.trial151.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:04:24.114 DEBUG:teuthology.orchestra.run.trial151:> sudo command -v grubby && echo yes || echo no 2026-02-17T00:04:24.177 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/grubby 2026-02-17T00:04:24.179 INFO:teuthology.orchestra.run.trial151.stdout:yes 2026-02-17T00:04:24.179 DEBUG:teuthology.orchestra.run.trial151:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T00:04:24.243 INFO:teuthology.orchestra.run.trial151.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:04:24.243 DEBUG:teuthology.orchestra.run.trial151:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T00:04:24.316 DEBUG:teuthology.orchestra.run.trial151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T00:04:24.525 INFO:teuthology.orchestra.run.trial151.stderr:Generating grub configuration file ... 2026-02-17T00:04:24.589 INFO:teuthology.orchestra.run.trial151.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T00:04:24.595 INFO:teuthology.orchestra.run.trial151.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T00:04:24.850 INFO:teuthology.orchestra.run.trial151.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T00:04:24.856 INFO:teuthology.orchestra.run.trial151.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T00:04:24.888 INFO:teuthology.orchestra.run.trial151.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T00:04:24.895 INFO:teuthology.orchestra.run.trial151.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T00:04:24.918 INFO:teuthology.orchestra.run.trial151.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T00:04:24.925 INFO:teuthology.orchestra.run.trial151.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T00:04:25.007 INFO:teuthology.orchestra.run.trial151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T00:04:25.015 INFO:teuthology.orchestra.run.trial151.stderr:done 2026-02-17T00:04:25.016 DEBUG:teuthology.orchestra.run.trial151:> test -d /sys/firmware/efi 2026-02-17T00:04:25.033 DEBUG:teuthology.orchestra.run.trial151:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T00:04:25.100 INFO:teuthology.orchestra.run.trial151.stdout:/boot/efi/EFI/BOOT 2026-02-17T00:04:25.100 INFO:teuthology.orchestra.run.trial151.stdout:/boot/efi/EFI/centos 2026-02-17T00:04:25.102 DEBUG:teuthology.orchestra.run.trial151:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T00:04:25.167 INFO:teuthology.orchestra.run.trial151.stdout:no 2026-02-17T00:04:25.168 DEBUG:teuthology.orchestra.run.trial151:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T00:04:25.234 INFO:teuthology.orchestra.run.trial151.stdout:yes 2026-02-17T00:04:25.234 DEBUG:teuthology.orchestra.run.trial151:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T00:04:25.298 DEBUG:teuthology.orchestra.run.trial151:> sudo shutdown -r now 2026-02-17T00:04:25.373 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-17T00:04:41.665 INFO:teuthology.orchestra.run.trial196.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 853 kB/s | 31 MB 00:37 2026-02-17T00:04:41.667 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:04:41.668 INFO:teuthology.orchestra.run.trial196.stdout:Total 2.3 MB/s | 88 MB 00:38 2026-02-17T00:04:41.856 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-17T00:04:42.059 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-17T00:04:42.059 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-17T00:04:42.403 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-17T00:04:42.404 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-17T00:04:43.488 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-17T00:04:43.772 INFO:teuthology.orchestra.run.trial196.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:04:43.791 INFO:teuthology.orchestra.run.trial196.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:04:45.570 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:04:45.599 INFO:teuthology.orchestra.run.trial196.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:04:48.831 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:04:48.837 INFO:teuthology.orchestra.run.trial196.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:04:51.937 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:04:55.341 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-17T00:04:55.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial151.front.sepia.ceph.com' 2026-02-17T00:04:55.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:05:22.421 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:05:22.441 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:05:22.607 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:05:22.607 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:05:22.607 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:05:22.607 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:05:22.660 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:05:22.660 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:05:22.661 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-17T00:05:22.661 INFO:teuthology.orchestra.run.trial196.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T00:05:22.661 INFO:teuthology.orchestra.run.trial196.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T00:05:22.661 INFO:teuthology.orchestra.run.trial196.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T00:05:22.661 INFO:teuthology.orchestra.run.trial196.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T00:05:22.661 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:05:22.661 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-17T00:05:22.718 DEBUG:teuthology.orchestra.run.trial196:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:05:22.744 INFO:teuthology.orchestra.run.trial196.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:05:22.745 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:05:22.745 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T00:05:22.745 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T00:05:22.745 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T00:05:22.745 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-17T00:05:22.745 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial196.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T00:05:22.745 DEBUG:teuthology.orchestra.run.trial196:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:05:22.808 INFO:teuthology.orchestra.run.trial196.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:05:22.808 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:05:22.808 DEBUG:teuthology.orchestra.run.trial196:> sudo rpm -qi grub2-tools 2026-02-17T00:05:22.877 INFO:teuthology.orchestra.run.trial196.stdout:Name : grub2-tools 2026-02-17T00:05:22.877 INFO:teuthology.orchestra.run.trial196.stdout:Epoch : 1 2026-02-17T00:05:22.877 INFO:teuthology.orchestra.run.trial196.stdout:Version : 2.06 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Release : 118.el9 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Architecture: x86_64 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Group : Unspecified 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Size : 8393909 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:License : GPLv3+ 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Packager : builder@centos.org 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Vendor : CentOS 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Summary : Support tools for GRUB. 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:Description : 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T00:05:22.878 INFO:teuthology.orchestra.run.trial196.stdout:hardware devices. 2026-02-17T00:05:22.879 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:05:22.879 INFO:teuthology.orchestra.run.trial196.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T00:05:22.879 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T00:05:22.879 INFO:teuthology.task.kernel:Updating grub on trial196 to boot 5.14.0-681.el9.x86_64 2026-02-17T00:05:22.880 DEBUG:teuthology.orchestra.run.trial196:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T00:05:22.942 INFO:teuthology.orchestra.run.trial196.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:05:22.943 DEBUG:teuthology.orchestra.run.trial196:> sudo command -v grubby && echo yes || echo no 2026-02-17T00:05:23.007 INFO:teuthology.orchestra.run.trial196.stdout:/sbin/grubby 2026-02-17T00:05:23.008 INFO:teuthology.orchestra.run.trial196.stdout:yes 2026-02-17T00:05:23.009 DEBUG:teuthology.orchestra.run.trial196:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T00:05:23.072 INFO:teuthology.orchestra.run.trial196.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:05:23.073 DEBUG:teuthology.orchestra.run.trial196:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T00:05:23.144 DEBUG:teuthology.orchestra.run.trial196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T00:05:23.350 INFO:teuthology.orchestra.run.trial196.stderr:Generating grub configuration file ... 2026-02-17T00:05:23.412 INFO:teuthology.orchestra.run.trial196.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T00:05:23.419 INFO:teuthology.orchestra.run.trial196.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T00:05:23.668 INFO:teuthology.orchestra.run.trial196.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T00:05:23.675 INFO:teuthology.orchestra.run.trial196.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T00:05:23.707 INFO:teuthology.orchestra.run.trial196.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T00:05:23.713 INFO:teuthology.orchestra.run.trial196.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T00:05:23.736 INFO:teuthology.orchestra.run.trial196.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T00:05:23.743 INFO:teuthology.orchestra.run.trial196.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T00:05:23.824 INFO:teuthology.orchestra.run.trial196.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T00:05:23.833 INFO:teuthology.orchestra.run.trial196.stderr:done 2026-02-17T00:05:23.835 DEBUG:teuthology.orchestra.run.trial196:> test -d /sys/firmware/efi 2026-02-17T00:05:23.851 DEBUG:teuthology.orchestra.run.trial196:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T00:05:23.916 INFO:teuthology.orchestra.run.trial196.stdout:/boot/efi/EFI/BOOT 2026-02-17T00:05:23.916 INFO:teuthology.orchestra.run.trial196.stdout:/boot/efi/EFI/centos 2026-02-17T00:05:23.918 DEBUG:teuthology.orchestra.run.trial196:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T00:05:23.983 INFO:teuthology.orchestra.run.trial196.stdout:no 2026-02-17T00:05:23.984 DEBUG:teuthology.orchestra.run.trial196:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T00:05:24.047 INFO:teuthology.orchestra.run.trial196.stdout:yes 2026-02-17T00:05:24.047 DEBUG:teuthology.orchestra.run.trial196:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T00:05:24.111 DEBUG:teuthology.orchestra.run.trial196:> sudo shutdown -r now 2026-02-17T00:05:24.186 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-17T00:05:54.182 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-17T00:05:54.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T00:05:54.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:05:55.345 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T00:06:04.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial151.front.sepia.ceph.com' 2026-02-17T00:06:04.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:06:04.449 DEBUG:teuthology.orchestra.run.trial151:> true 2026-02-17T00:06:04.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial151.front.sepia.ceph.com' 2026-02-17T00:06:04.609 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T00:06:04.609 DEBUG:teuthology.orchestra.run.trial151:> uname -r 2026-02-17T00:06:04.667 INFO:teuthology.orchestra.run.trial151.stdout:5.14.0-681.el9.x86_64 2026-02-17T00:06:04.668 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T00:06:04.668 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T00:06:04.668 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T00:06:05.669 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-17T00:06:05.669 DEBUG:teuthology.orchestra.run.trial151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T00:06:05.698 INFO:teuthology.orchestra.run.trial151.stdout:ttyS1 2026-02-17T00:06:05.719 DEBUG:teuthology.parallel:result is None 2026-02-17T00:06:54.185 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T00:07:03.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T00:07:03.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:07:03.353 DEBUG:teuthology.orchestra.run.trial196:> true 2026-02-17T00:07:03.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T00:07:03.497 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T00:07:03.497 DEBUG:teuthology.orchestra.run.trial196:> uname -r 2026-02-17T00:07:03.552 INFO:teuthology.orchestra.run.trial196.stdout:5.14.0-681.el9.x86_64 2026-02-17T00:07:03.553 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T00:07:03.553 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T00:07:03.553 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T00:07:04.553 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-17T00:07:04.553 DEBUG:teuthology.orchestra.run.trial196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T00:07:04.581 INFO:teuthology.orchestra.run.trial196.stdout:ttyS1 2026-02-17T00:07:04.601 DEBUG:teuthology.parallel:result is None 2026-02-17T00:07:04.601 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T00:07:04.619 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T00:07:04.619 DEBUG:teuthology.orchestra.run.trial151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T00:07:04.621 DEBUG:teuthology.orchestra.run.trial196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T00:07:04.657 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T00:07:04.668 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T00:07:04.681 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T00:07:04.681 DEBUG:teuthology.orchestra.run.trial151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T00:07:04.684 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T00:07:04.715 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T00:07:04.726 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T00:07:04.726 DEBUG:teuthology.orchestra.run.trial151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T00:07:04.743 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T00:07:04.766 INFO:teuthology.orchestra.run.trial151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:07:04.774 INFO:teuthology.orchestra.run.trial151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:07:04.778 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:07:04.787 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:07:04.788 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T00:07:04.799 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T00:07:04.799 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T00:07:04.817 DEBUG:teuthology.orchestra.run.trial196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T00:07:04.853 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T00:07:04.870 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T00:07:04.870 DEBUG:teuthology.orchestra.run.trial151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T00:07:04.883 DEBUG:teuthology.orchestra.run.trial196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T00:07:04.909 DEBUG:teuthology.orchestra.run.trial151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:07:05.034 DEBUG:teuthology.orchestra.run.trial151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:07:05.059 DEBUG:teuthology.orchestra.run.trial151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:07:05.197 DEBUG:teuthology.orchestra.run.trial151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:07:05.221 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:07:05.221 DEBUG:teuthology.orchestra.run.trial151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T00:07:05.285 DEBUG:teuthology.orchestra.run.trial196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:07:05.401 DEBUG:teuthology.orchestra.run.trial196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:07:05.426 DEBUG:teuthology.orchestra.run.trial196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:07:05.573 DEBUG:teuthology.orchestra.run.trial196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:07:05.598 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:07:05.598 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T00:07:05.664 DEBUG:teuthology.orchestra.run.trial151:> sudo service rsyslog restart 2026-02-17T00:07:05.666 DEBUG:teuthology.orchestra.run.trial196:> sudo service rsyslog restart 2026-02-17T00:07:05.692 INFO:teuthology.orchestra.run.trial151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T00:07:05.733 INFO:teuthology.orchestra.run.trial196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T00:07:06.143 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T00:07:06.155 INFO:teuthology.task.internal:Starting timer... 2026-02-17T00:07:06.155 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T00:07:06.176 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T00:07:06.195 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-17T00:07:06.195 DEBUG:teuthology.orchestra.run.trial151:> sudo service auditd rotate 2026-02-17T00:07:06.223 INFO:teuthology.orchestra.run.trial151.stdout:Rotating logs: 2026-02-17T00:07:06.225 DEBUG:teuthology.orchestra.run.trial196:> sudo service auditd rotate 2026-02-17T00:07:06.255 INFO:teuthology.orchestra.run.trial196.stdout:Rotating logs: 2026-02-17T00:07:06.257 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T00:07:06.257 DEBUG:teuthology.orchestra.run.trial151:> /usr/sbin/getenforce 2026-02-17T00:07:06.280 INFO:teuthology.orchestra.run.trial151.stdout:Permissive 2026-02-17T00:07:06.281 DEBUG:teuthology.orchestra.run.trial196:> /usr/sbin/getenforce 2026-02-17T00:07:06.314 INFO:teuthology.orchestra.run.trial196.stdout:Permissive 2026-02-17T00:07:06.314 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial151.front.sepia.ceph.com': 'permissive', 'ubuntu@trial196.front.sepia.ceph.com': 'permissive'} 2026-02-17T00:07:06.314 DEBUG:teuthology.orchestra.run.trial151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T00:07:06.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:07:06.345 DEBUG:teuthology.orchestra.run.trial196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T00:07:06.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:07:06.379 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T00:07:06.379 DEBUG:teuthology.orchestra.run.trial151:> sudo /usr/sbin/setenforce permissive 2026-02-17T00:07:06.409 DEBUG:teuthology.orchestra.run.trial196:> sudo /usr/sbin/setenforce permissive 2026-02-17T00:07:06.444 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T00:07:06.460 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T00:07:06.472 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T00:07:06.473 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial151.front.sepia.ceph.com,trial196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T00:09:57.968 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial151.front.sepia.ceph.com'), Remote(name='ubuntu@trial196.front.sepia.ceph.com')] 2026-02-17T00:09:57.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial151.front.sepia.ceph.com' 2026-02-17T00:09:57.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:09:58.050 DEBUG:teuthology.orchestra.run.trial151:> true 2026-02-17T00:09:58.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial151.front.sepia.ceph.com' 2026-02-17T00:09:58.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T00:09:58.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:09:58.205 DEBUG:teuthology.orchestra.run.trial196:> true 2026-02-17T00:09:58.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T00:09:58.279 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T00:09:58.294 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T00:09:58.294 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T00:09:58.294 DEBUG:teuthology.orchestra.run.trial151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:09:58.296 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T00:09:58.296 DEBUG:teuthology.orchestra.run.trial196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:09:58.322 INFO:teuthology.orchestra.run.trial151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T00:09:58.334 INFO:teuthology.orchestra.run.trial151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T00:09:58.345 INFO:teuthology.orchestra.run.trial196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T00:09:58.354 INFO:teuthology.orchestra.run.trial151.stderr:sudo: ntpd: command not found 2026-02-17T00:09:58.357 INFO:teuthology.orchestra.run.trial196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T00:09:58.363 INFO:teuthology.orchestra.run.trial151.stdout:506 Cannot talk to daemon 2026-02-17T00:09:58.374 INFO:teuthology.orchestra.run.trial151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T00:09:58.377 INFO:teuthology.orchestra.run.trial196.stderr:sudo: ntpd: command not found 2026-02-17T00:09:58.385 INFO:teuthology.orchestra.run.trial151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T00:09:58.387 INFO:teuthology.orchestra.run.trial196.stdout:506 Cannot talk to daemon 2026-02-17T00:09:58.398 INFO:teuthology.orchestra.run.trial196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T00:09:58.411 INFO:teuthology.orchestra.run.trial196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T00:09:58.430 INFO:teuthology.orchestra.run.trial151.stderr:bash: line 1: ntpq: command not found 2026-02-17T00:09:58.446 INFO:teuthology.orchestra.run.trial151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T00:09:58.446 INFO:teuthology.orchestra.run.trial151.stdout:=============================================================================== 2026-02-17T00:09:58.446 INFO:teuthology.orchestra.run.trial151.stdout:^? cambria.bitsrc.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.446 INFO:teuthology.orchestra.run.trial151.stdout:^? ntp.netlinkify.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.446 INFO:teuthology.orchestra.run.trial151.stdout:^? rn-03.koehn.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.446 INFO:teuthology.orchestra.run.trial151.stdout:^? frumentum-zeus.infra.fru> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.460 INFO:teuthology.orchestra.run.trial196.stderr:bash: line 1: ntpq: command not found 2026-02-17T00:09:58.478 INFO:teuthology.orchestra.run.trial196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T00:09:58.478 INFO:teuthology.orchestra.run.trial196.stdout:=============================================================================== 2026-02-17T00:09:58.478 INFO:teuthology.orchestra.run.trial196.stdout:^? baron.cgee.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.478 INFO:teuthology.orchestra.run.trial196.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.478 INFO:teuthology.orchestra.run.trial196.stdout:^? nyc3.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.478 INFO:teuthology.orchestra.run.trial196.stdout:^? time1.lshiy.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:09:58.478 INFO:teuthology.run_tasks:Running task pexec... 2026-02-17T00:09:58.490 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-17T00:09:58.491 DEBUG:teuthology.orchestra.run.trial151:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T00:09:58.491 DEBUG:teuthology.orchestra.run.trial196:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T00:09:58.493 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial151.front.sepia.ceph.com 2026-02-17T00:09:58.493 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T00:09:58.493 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T00:09:58.520 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial196.front.sepia.ceph.com 2026-02-17T00:09:58.520 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T00:09:58.520 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T00:09:58.663 INFO:teuthology.orchestra.run.trial151.stdout:No match for argument: nvme-cli 2026-02-17T00:09:58.663 INFO:teuthology.orchestra.run.trial151.stderr:No packages marked for removal. 2026-02-17T00:09:58.666 INFO:teuthology.orchestra.run.trial151.stdout:Dependencies resolved. 2026-02-17T00:09:58.666 INFO:teuthology.orchestra.run.trial151.stdout:Nothing to do. 2026-02-17T00:09:58.666 INFO:teuthology.orchestra.run.trial151.stdout:Complete! 2026-02-17T00:09:58.692 INFO:teuthology.orchestra.run.trial196.stdout:No match for argument: nvme-cli 2026-02-17T00:09:58.693 INFO:teuthology.orchestra.run.trial196.stderr:No packages marked for removal. 2026-02-17T00:09:58.695 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-17T00:09:58.696 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-17T00:09:58.696 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-17T00:09:58.969 INFO:teuthology.orchestra.run.trial151.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 12:09:17 AM UTC. 2026-02-17T00:09:58.998 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 12:09:18 AM UTC. 2026-02-17T00:09:59.051 INFO:teuthology.orchestra.run.trial151.stdout:Dependencies resolved. 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout:================================================================================ 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout: Package Architecture Version Repository Size 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout:================================================================================ 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout:Installing: 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout:Upgrading: 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout:Installing dependencies: 2026-02-17T00:09:59.052 INFO:teuthology.orchestra.run.trial151.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout:Transaction Summary 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout:================================================================================ 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout:Install 6 Packages 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout:Upgrade 1 Package 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout:Total download size: 2.4 M 2026-02-17T00:09:59.053 INFO:teuthology.orchestra.run.trial151.stdout:Downloading Packages: 2026-02-17T00:09:59.079 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-17T00:09:59.079 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout: Package Architecture Version Repository Size 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout:Upgrading: 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout:Installing dependencies: 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T00:09:59.080 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T00:09:59.081 INFO:teuthology.orchestra.run.trial196.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T00:09:59.081 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:09:59.081 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-17T00:09:59.081 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-17T00:09:59.081 INFO:teuthology.orchestra.run.trial196.stdout:Install 6 Packages 2026-02-17T00:09:59.081 INFO:teuthology.orchestra.run.trial196.stdout:Upgrade 1 Package 2026-02-17T00:09:59.081 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:09:59.082 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 2.4 M 2026-02-17T00:09:59.082 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-17T00:09:59.787 INFO:teuthology.orchestra.run.trial151.stdout:(1/7): python3-configshell-1.1.30-1.el9.noarch. 106 kB/s | 72 kB 00:00 2026-02-17T00:09:59.795 INFO:teuthology.orchestra.run.trial151.stdout:(2/7): nvmetcli-0.8-3.el9.noarch.rpm 64 kB/s | 44 kB 00:00 2026-02-17T00:09:59.925 INFO:teuthology.orchestra.run.trial196.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 82 kB/s | 44 kB 00:00 2026-02-17T00:09:59.933 INFO:teuthology.orchestra.run.trial196.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 132 kB/s | 72 kB 00:00 2026-02-17T00:10:00.032 INFO:teuthology.orchestra.run.trial151.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 344 kB/s | 84 kB 00:00 2026-02-17T00:10:00.108 INFO:teuthology.orchestra.run.trial196.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 461 kB/s | 84 kB 00:00 2026-02-17T00:10:00.200 INFO:teuthology.orchestra.run.trial196.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 564 kB/s | 150 kB 00:00 2026-02-17T00:10:00.205 INFO:teuthology.orchestra.run.trial151.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 367 kB/s | 150 kB 00:00 2026-02-17T00:10:00.384 INFO:teuthology.orchestra.run.trial196.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 630 kB/s | 116 kB 00:00 2026-02-17T00:10:00.451 INFO:teuthology.orchestra.run.trial151.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 473 kB/s | 116 kB 00:00 2026-02-17T00:10:01.018 INFO:teuthology.orchestra.run.trial151.stdout:(6/7): nvme-cli-2.16-1.el9.x86_64.rpm 618 kB/s | 1.2 MB 00:01 2026-02-17T00:10:01.171 INFO:teuthology.orchestra.run.trial151.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 735 kB/s | 837 kB 00:01 2026-02-17T00:10:01.172 INFO:teuthology.orchestra.run.trial151.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:10:01.172 INFO:teuthology.orchestra.run.trial151.stdout:Total 1.1 MB/s | 2.4 MB 00:02 2026-02-17T00:10:01.182 INFO:teuthology.orchestra.run.trial196.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 780 kB/s | 837 kB 00:01 2026-02-17T00:10:01.236 INFO:teuthology.orchestra.run.trial151.stdout:Running transaction check 2026-02-17T00:10:01.245 INFO:teuthology.orchestra.run.trial151.stdout:Transaction check succeeded. 2026-02-17T00:10:01.245 INFO:teuthology.orchestra.run.trial151.stdout:Running transaction test 2026-02-17T00:10:01.295 INFO:teuthology.orchestra.run.trial151.stdout:Transaction test succeeded. 2026-02-17T00:10:01.295 INFO:teuthology.orchestra.run.trial151.stdout:Running transaction 2026-02-17T00:10:01.364 INFO:teuthology.orchestra.run.trial151.stdout: Preparing : 1/1 2026-02-17T00:10:01.431 INFO:teuthology.orchestra.run.trial151.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-17T00:10:01.438 INFO:teuthology.orchestra.run.trial151.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-17T00:10:01.446 INFO:teuthology.orchestra.run.trial151.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-17T00:10:01.452 INFO:teuthology.orchestra.run.trial151.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-17T00:10:01.457 INFO:teuthology.orchestra.run.trial151.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-17T00:10:01.458 INFO:teuthology.orchestra.run.trial151.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T00:10:01.604 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T00:10:01.606 INFO:teuthology.orchestra.run.trial151.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T00:10:01.879 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T00:10:01.879 INFO:teuthology.orchestra.run.trial151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T00:10:01.879 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:01.902 INFO:teuthology.orchestra.run.trial151.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-17T00:10:02.123 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-17T00:10:02.178 INFO:teuthology.orchestra.run.trial151.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:10:02.178 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:02.178 INFO:teuthology.orchestra.run.trial151.stdout:Upgraded: 2026-02-17T00:10:02.179 INFO:teuthology.orchestra.run.trial151.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T00:10:02.179 INFO:teuthology.orchestra.run.trial151.stdout:Installed: 2026-02-17T00:10:02.179 INFO:teuthology.orchestra.run.trial151.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T00:10:02.179 INFO:teuthology.orchestra.run.trial151.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T00:10:02.179 INFO:teuthology.orchestra.run.trial151.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T00:10:02.179 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:02.179 INFO:teuthology.orchestra.run.trial151.stdout:Complete! 2026-02-17T00:10:02.209 DEBUG:teuthology.parallel:result is None 2026-02-17T00:10:02.362 INFO:teuthology.orchestra.run.trial196.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 396 kB/s | 1.2 MB 00:02 2026-02-17T00:10:02.364 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:10:02.364 INFO:teuthology.orchestra.run.trial196.stdout:Total 756 kB/s | 2.4 MB 00:03 2026-02-17T00:10:02.427 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-17T00:10:02.435 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-17T00:10:02.435 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-17T00:10:02.485 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-17T00:10:02.485 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-17T00:10:02.554 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-17T00:10:02.624 INFO:teuthology.orchestra.run.trial196.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-17T00:10:02.630 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-17T00:10:02.639 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-17T00:10:02.645 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-17T00:10:02.650 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-17T00:10:02.651 INFO:teuthology.orchestra.run.trial196.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T00:10:02.797 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T00:10:02.799 INFO:teuthology.orchestra.run.trial196.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T00:10:03.074 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T00:10:03.074 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T00:10:03.074 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:03.098 INFO:teuthology.orchestra.run.trial196.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:10:03.314 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:10:03.314 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-17T00:10:03.315 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-17T00:10:03.315 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-17T00:10:03.315 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-17T00:10:03.315 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-17T00:10:03.315 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-17T00:10:03.315 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-17T00:10:03.372 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T00:10:03.372 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:03.372 INFO:teuthology.orchestra.run.trial196.stdout:Upgraded: 2026-02-17T00:10:03.372 INFO:teuthology.orchestra.run.trial196.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T00:10:03.372 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-17T00:10:03.372 INFO:teuthology.orchestra.run.trial196.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T00:10:03.373 INFO:teuthology.orchestra.run.trial196.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T00:10:03.373 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T00:10:03.373 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:03.373 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-17T00:10:03.401 DEBUG:teuthology.parallel:result is None 2026-02-17T00:10:03.402 INFO:teuthology.run_tasks:Running task nvme_loop... 2026-02-17T00:10:03.426 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices... 2026-02-17T00:10:03.426 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:03.426 DEBUG:teuthology.orchestra.run.trial151:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:10:03.447 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T00:10:03.447 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/vg_nvme/lv_1 2026-02-17T00:10:03.506 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T00:10:03.506 INFO:teuthology.orchestra.run.trial151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:03.506 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-17T00:10:03.507 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:03.507 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:03.507 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:02.032659442 +0000 2026-02-17T00:10:03.507 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:01.896659395 +0000 2026-02-17T00:10:03.507 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:01.896659395 +0000 2026-02-17T00:10:03.507 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:01.896659395 +0000 2026-02-17T00:10:03.508 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T00:10:03.571 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:10:03.571 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:10:03.571 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000152032 s, 3.4 MB/s 2026-02-17T00:10:03.573 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T00:10:03.630 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/vg_nvme/lv_2 2026-02-17T00:10:03.686 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T00:10:03.686 INFO:teuthology.orchestra.run.trial151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:03.687 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-17T00:10:03.687 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:03.687 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:03.687 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:02.032659442 +0000 2026-02-17T00:10:03.687 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:03.687 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:03.687 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:03.687 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T00:10:03.749 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:10:03.750 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:10:03.750 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000145137 s, 3.5 MB/s 2026-02-17T00:10:03.751 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T00:10:03.807 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/vg_nvme/lv_3 2026-02-17T00:10:03.863 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:02.032659442 +0000 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:03.864 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:03.865 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T00:10:03.926 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:10:03.926 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:10:03.926 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000150816 s, 3.4 MB/s 2026-02-17T00:10:03.927 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T00:10:03.984 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/vg_nvme/lv_4 2026-02-17T00:10:04.040 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T00:10:04.040 INFO:teuthology.orchestra.run.trial151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:04.040 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-17T00:10:04.040 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:04.041 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:04.041 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:02.033659442 +0000 2026-02-17T00:10:04.041 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:04.041 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:04.041 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:01.895659395 +0000 2026-02-17T00:10:04.041 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T00:10:04.103 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:10:04.103 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:10:04.103 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000148293 s, 3.5 MB/s 2026-02-17T00:10:04.105 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T00:10:04.162 DEBUG:teuthology.orchestra.run.trial151:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2026-02-17T00:10:04.271 INFO:teuthology.orchestra.run.trial151.stdout:loop 2026-02-17T00:10:04.273 INFO:tasks.nvme_loop:Connecting nvme_loop trial151:/dev/vg_nvme/lv_1... 2026-02-17T00:10:04.273 DEBUG:teuthology.orchestra.run.trial151:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2026-02-17T00:10:04.303 INFO:teuthology.orchestra.run.trial151.stdout:1 2026-02-17T00:10:04.334 INFO:teuthology.orchestra.run.trial151.stdout:/dev/vg_nvme/lv_11 2026-02-17T00:10:04.369 INFO:teuthology.orchestra.run.trial151.stdout:connecting to device: nvme3 2026-02-17T00:10:04.371 INFO:tasks.nvme_loop:Connecting nvme_loop trial151:/dev/vg_nvme/lv_2... 2026-02-17T00:10:04.371 DEBUG:teuthology.orchestra.run.trial151:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2026-02-17T00:10:04.446 INFO:teuthology.orchestra.run.trial151.stdout:1 2026-02-17T00:10:04.472 INFO:teuthology.orchestra.run.trial151.stdout:/dev/vg_nvme/lv_21 2026-02-17T00:10:04.501 INFO:teuthology.orchestra.run.trial151.stdout:connecting to device: nvme4 2026-02-17T00:10:04.507 INFO:tasks.nvme_loop:Connecting nvme_loop trial151:/dev/vg_nvme/lv_3... 2026-02-17T00:10:04.507 DEBUG:teuthology.orchestra.run.trial151:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2026-02-17T00:10:04.580 INFO:teuthology.orchestra.run.trial151.stdout:1 2026-02-17T00:10:04.606 INFO:teuthology.orchestra.run.trial151.stdout:/dev/vg_nvme/lv_31 2026-02-17T00:10:04.634 INFO:teuthology.orchestra.run.trial151.stdout:connecting to device: nvme5 2026-02-17T00:10:04.635 INFO:tasks.nvme_loop:Connecting nvme_loop trial151:/dev/vg_nvme/lv_4... 2026-02-17T00:10:04.635 DEBUG:teuthology.orchestra.run.trial151:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2026-02-17T00:10:04.706 INFO:teuthology.orchestra.run.trial151.stdout:1 2026-02-17T00:10:04.731 INFO:teuthology.orchestra.run.trial151.stdout:/dev/vg_nvme/lv_41 2026-02-17T00:10:04.760 INFO:teuthology.orchestra.run.trial151.stdout:connecting to device: nvme6 2026-02-17T00:10:04.762 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:04.762 DEBUG:teuthology.orchestra.run.trial151:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:10:04.819 DEBUG:teuthology.orchestra.run.trial151:> lsblk 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:nvme2n1 259:0 0 1.7T 0 disk 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:├─vg_nvme-lv_3 253:2 0 700G 0 lvm 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:└─vg_nvme-lv_4 253:3 0 700G 0 lvm 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:nvme0n1 259:1 0 894.3G 0 disk 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:├─nvme0n1p1 259:3 0 512M 0 part /boot/efi 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:└─nvme0n1p2 259:4 0 893.8G 0 part / 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:nvme1n1 259:2 0 1.7T 0 disk 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:├─vg_nvme-lv_1 253:0 0 700G 0 lvm 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:├─vg_nvme-lv_2 253:1 0 700G 0 lvm 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:└─vg_nvme-lv_5 253:4 0 100G 0 lvm /var/lib/ceph 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:nvme3n1 259:6 0 700G 0 disk 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:nvme4n1 259:8 0 700G 0 disk 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:nvme5n1 259:10 0 700G 0 disk 2026-02-17T00:10:04.876 INFO:teuthology.orchestra.run.trial151.stdout:nvme6n1 259:12 0 700G 0 disk 2026-02-17T00:10:04.877 DEBUG:teuthology.orchestra.run.trial151:> sudo nvme list -o json 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout:{ 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "Devices":[ 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: { 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "NameSpace":1, 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "DevicePath":"/dev/nvme0n1", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "GenericPath":"/dev/ng0n1", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "Firmware":"E2MU200", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "SerialNumber":"25174FCD492E", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "UsedBytes":20322455552, 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "MaximumLBA":1875385008, 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "PhysicalSize":960197124096, 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "SectorSize":512 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: }, 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: { 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "NameSpace":1, 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "DevicePath":"/dev/nvme1n1", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "GenericPath":"/dev/ng1n1", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "Firmware":"E3MQ000", 2026-02-17T00:10:04.943 INFO:teuthology.orchestra.run.trial151.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SerialNumber":"012510B00266", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "UsedBytes":42732904448, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "MaximumLBA":3750748848, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "PhysicalSize":1920383410176, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SectorSize":512 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: }, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: { 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "NameSpace":1, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "DevicePath":"/dev/nvme2n1", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "GenericPath":"/dev/ng2n1", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "Firmware":"E3MQ000", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SerialNumber":"012510B002D5", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "UsedBytes":138888257536, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "MaximumLBA":3750748848, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "PhysicalSize":1920383410176, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SectorSize":512 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: }, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: { 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "NameSpace":1, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "DevicePath":"/dev/nvme3n1", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "GenericPath":"/dev/ng3n1", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SerialNumber":"68c46a24a7e86f5e226e", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SectorSize":512 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: }, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: { 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "NameSpace":1, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "DevicePath":"/dev/nvme4n1", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "GenericPath":"/dev/ng4n1", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SerialNumber":"528323697d53fff9e321", 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: "SectorSize":512 2026-02-17T00:10:04.944 INFO:teuthology.orchestra.run.trial151.stdout: }, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: { 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "NameSpace":1, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "DevicePath":"/dev/nvme5n1", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "GenericPath":"/dev/ng5n1", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "SerialNumber":"ea9f59d8a66cac27b3e5", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "SectorSize":512 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: }, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: { 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "NameSpace":1, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "DevicePath":"/dev/nvme6n1", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "GenericPath":"/dev/ng6n1", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "SerialNumber":"46d5e66c499017cd469d", 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: "SectorSize":512 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: } 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout: ] 2026-02-17T00:10:04.945 INFO:teuthology.orchestra.run.trial151.stdout:} 2026-02-17T00:10:04.946 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=0 bs=1 count=4096 2026-02-17T00:10:05.012 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.012 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.012 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00459794 s, 891 kB/s 2026-02-17T00:10:05.013 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s0 /dev/nvme3n1 2026-02-17T00:10:05.076 INFO:teuthology.orchestra.run.trial151.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:05.076 INFO:teuthology.orchestra.run.trial151.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:05.076 INFO:teuthology.orchestra.run.trial151.stdout:00000016 2026-02-17T00:10:05.077 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:05.144 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.144 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.144 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00440422 s, 930 kB/s 2026-02-17T00:10:05.145 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s1073741824 /dev/nvme3n1 2026-02-17T00:10:05.208 INFO:teuthology.orchestra.run.trial151.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:05.208 INFO:teuthology.orchestra.run.trial151.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:05.208 INFO:teuthology.orchestra.run.trial151.stdout:40000016 2026-02-17T00:10:05.209 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:05.276 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.276 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.276 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00446561 s, 917 kB/s 2026-02-17T00:10:05.277 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s10737418240 /dev/nvme3n1 2026-02-17T00:10:05.341 INFO:teuthology.orchestra.run.trial151.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:05.341 INFO:teuthology.orchestra.run.trial151.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:05.341 INFO:teuthology.orchestra.run.trial151.stdout:280000016 2026-02-17T00:10:05.342 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=0 bs=1 count=4096 2026-02-17T00:10:05.409 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.409 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.409 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00525587 s, 779 kB/s 2026-02-17T00:10:05.410 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s0 /dev/nvme4n1 2026-02-17T00:10:05.472 INFO:teuthology.orchestra.run.trial151.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:05.472 INFO:teuthology.orchestra.run.trial151.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:05.472 INFO:teuthology.orchestra.run.trial151.stdout:00000016 2026-02-17T00:10:05.473 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:05.540 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.540 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.540 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00481361 s, 851 kB/s 2026-02-17T00:10:05.541 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s1073741824 /dev/nvme4n1 2026-02-17T00:10:05.603 INFO:teuthology.orchestra.run.trial151.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:05.603 INFO:teuthology.orchestra.run.trial151.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:05.603 INFO:teuthology.orchestra.run.trial151.stdout:40000016 2026-02-17T00:10:05.604 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:05.671 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.672 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.672 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.005078 s, 807 kB/s 2026-02-17T00:10:05.674 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s10737418240 /dev/nvme4n1 2026-02-17T00:10:05.736 INFO:teuthology.orchestra.run.trial151.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:05.736 INFO:teuthology.orchestra.run.trial151.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:05.736 INFO:teuthology.orchestra.run.trial151.stdout:280000016 2026-02-17T00:10:05.737 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=0 bs=1 count=4096 2026-02-17T00:10:05.805 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.805 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.805 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00524722 s, 781 kB/s 2026-02-17T00:10:05.806 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s0 /dev/nvme5n1 2026-02-17T00:10:05.868 INFO:teuthology.orchestra.run.trial151.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:05.868 INFO:teuthology.orchestra.run.trial151.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:05.868 INFO:teuthology.orchestra.run.trial151.stdout:00000016 2026-02-17T00:10:05.869 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:05.937 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:05.937 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:05.937 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00445516 s, 919 kB/s 2026-02-17T00:10:05.938 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s1073741824 /dev/nvme5n1 2026-02-17T00:10:06.001 INFO:teuthology.orchestra.run.trial151.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:06.001 INFO:teuthology.orchestra.run.trial151.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:06.001 INFO:teuthology.orchestra.run.trial151.stdout:40000016 2026-02-17T00:10:06.003 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:06.070 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:06.070 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:06.070 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00467608 s, 876 kB/s 2026-02-17T00:10:06.071 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s10737418240 /dev/nvme5n1 2026-02-17T00:10:06.133 INFO:teuthology.orchestra.run.trial151.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:06.133 INFO:teuthology.orchestra.run.trial151.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:06.133 INFO:teuthology.orchestra.run.trial151.stdout:280000016 2026-02-17T00:10:06.134 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=0 bs=1 count=4096 2026-02-17T00:10:06.200 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:06.200 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:06.200 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00440093 s, 931 kB/s 2026-02-17T00:10:06.202 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s0 /dev/nvme6n1 2026-02-17T00:10:06.264 INFO:teuthology.orchestra.run.trial151.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:06.265 INFO:teuthology.orchestra.run.trial151.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:06.265 INFO:teuthology.orchestra.run.trial151.stdout:00000016 2026-02-17T00:10:06.266 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:06.333 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:06.333 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:06.333 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00498952 s, 821 kB/s 2026-02-17T00:10:06.335 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s1073741824 /dev/nvme6n1 2026-02-17T00:10:06.397 INFO:teuthology.orchestra.run.trial151.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:06.398 INFO:teuthology.orchestra.run.trial151.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:06.398 INFO:teuthology.orchestra.run.trial151.stdout:40000016 2026-02-17T00:10:06.399 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:06.465 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records in 2026-02-17T00:10:06.466 INFO:teuthology.orchestra.run.trial151.stderr:4096+0 records out 2026-02-17T00:10:06.466 INFO:teuthology.orchestra.run.trial151.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00447033 s, 916 kB/s 2026-02-17T00:10:06.467 DEBUG:teuthology.orchestra.run.trial151:> sudo hexdump -n22 -C -s10737418240 /dev/nvme6n1 2026-02-17T00:10:06.532 INFO:teuthology.orchestra.run.trial151.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:06.533 INFO:teuthology.orchestra.run.trial151.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:06.533 INFO:teuthology.orchestra.run.trial151.stdout:280000016 2026-02-17T00:10:06.534 INFO:tasks.nvme_loop:new_devs ['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-17T00:10:06.535 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:06.535 DEBUG:teuthology.orchestra.run.trial151:> sudo dd of=/scratch_devs 2026-02-17T00:10:06.597 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:10:06.598 DEBUG:teuthology.orchestra.run.trial196:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:10:06.618 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T00:10:06.618 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_1 2026-02-17T00:10:06.677 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T00:10:06.677 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:06.677 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T00:10:06.677 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:06.678 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:06.678 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:10:03.228394589 +0000 2026-02-17T00:10:06.678 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:06.678 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:06.678 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:06.678 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T00:10:06.745 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:10:06.746 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:10:06.746 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000145991 s, 3.5 MB/s 2026-02-17T00:10:06.747 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T00:10:06.805 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_2 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:10:03.228394589 +0000 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:06.861 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:06.862 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:06.862 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T00:10:06.926 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:10:06.926 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:10:06.926 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000149628 s, 3.4 MB/s 2026-02-17T00:10:06.928 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T00:10:06.985 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_3 2026-02-17T00:10:07.043 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T00:10:07.043 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:07.043 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T00:10:07.043 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:07.043 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:07.043 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:10:03.229394576 +0000 2026-02-17T00:10:07.043 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:03.095396357 +0000 2026-02-17T00:10:07.044 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:03.095396357 +0000 2026-02-17T00:10:07.044 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:03.095396357 +0000 2026-02-17T00:10:07.044 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T00:10:07.105 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:10:07.106 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:10:07.106 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000147544 s, 3.5 MB/s 2026-02-17T00:10:07.107 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T00:10:07.164 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_4 2026-02-17T00:10:07.221 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1288 Links: 1 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:10:03.229394576 +0000 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:07.222 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:03.094396370 +0000 2026-02-17T00:10:07.223 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T00:10:07.286 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:10:07.286 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:10:07.287 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000147925 s, 3.5 MB/s 2026-02-17T00:10:07.287 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T00:10:07.344 DEBUG:teuthology.orchestra.run.trial196:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2026-02-17T00:10:07.449 INFO:teuthology.orchestra.run.trial196.stdout:loop 2026-02-17T00:10:07.450 INFO:tasks.nvme_loop:Connecting nvme_loop trial196:/dev/vg_nvme/lv_1... 2026-02-17T00:10:07.451 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2026-02-17T00:10:07.483 INFO:teuthology.orchestra.run.trial196.stdout:1 2026-02-17T00:10:07.508 INFO:teuthology.orchestra.run.trial196.stdout:/dev/vg_nvme/lv_11 2026-02-17T00:10:07.538 INFO:teuthology.orchestra.run.trial196.stdout:connecting to device: nvme3 2026-02-17T00:10:07.539 INFO:tasks.nvme_loop:Connecting nvme_loop trial196:/dev/vg_nvme/lv_2... 2026-02-17T00:10:07.540 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2026-02-17T00:10:07.611 INFO:teuthology.orchestra.run.trial196.stdout:1 2026-02-17T00:10:07.636 INFO:teuthology.orchestra.run.trial196.stdout:/dev/vg_nvme/lv_21 2026-02-17T00:10:07.665 INFO:teuthology.orchestra.run.trial196.stdout:connecting to device: nvme4 2026-02-17T00:10:07.666 INFO:tasks.nvme_loop:Connecting nvme_loop trial196:/dev/vg_nvme/lv_3... 2026-02-17T00:10:07.666 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2026-02-17T00:10:07.737 INFO:teuthology.orchestra.run.trial196.stdout:1 2026-02-17T00:10:07.762 INFO:teuthology.orchestra.run.trial196.stdout:/dev/vg_nvme/lv_31 2026-02-17T00:10:07.791 INFO:teuthology.orchestra.run.trial196.stdout:connecting to device: nvme5 2026-02-17T00:10:07.792 INFO:tasks.nvme_loop:Connecting nvme_loop trial196:/dev/vg_nvme/lv_4... 2026-02-17T00:10:07.793 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2026-02-17T00:10:07.864 INFO:teuthology.orchestra.run.trial196.stdout:1 2026-02-17T00:10:07.890 INFO:teuthology.orchestra.run.trial196.stdout:/dev/vg_nvme/lv_41 2026-02-17T00:10:07.919 INFO:teuthology.orchestra.run.trial196.stdout:connecting to device: nvme6 2026-02-17T00:10:07.920 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:10:07.920 DEBUG:teuthology.orchestra.run.trial196:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:10:07.976 DEBUG:teuthology.orchestra.run.trial196:> lsblk 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:nvme2n1 259:0 0 1.7T 0 disk 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:├─vg_nvme-lv_3 253:2 0 700G 0 lvm 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:└─vg_nvme-lv_4 253:3 0 700G 0 lvm 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:nvme0n1 259:1 0 1.7T 0 disk 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:├─vg_nvme-lv_1 253:0 0 700G 0 lvm 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:├─vg_nvme-lv_2 253:1 0 700G 0 lvm 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:└─vg_nvme-lv_5 253:4 0 100G 0 lvm /var/lib/ceph 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:nvme1n1 259:2 0 894.3G 0 disk 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:├─nvme1n1p1 259:3 0 512M 0 part /boot/efi 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:└─nvme1n1p2 259:4 0 893.8G 0 part / 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:nvme3n1 259:6 0 700G 0 disk 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:nvme4n1 259:8 0 700G 0 disk 2026-02-17T00:10:08.034 INFO:teuthology.orchestra.run.trial196.stdout:nvme5n1 259:10 0 700G 0 disk 2026-02-17T00:10:08.035 INFO:teuthology.orchestra.run.trial196.stdout:nvme6n1 259:12 0 700G 0 disk 2026-02-17T00:10:08.035 DEBUG:teuthology.orchestra.run.trial196:> sudo nvme list -o json 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout:{ 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "Devices":[ 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: { 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "NameSpace":1, 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "DevicePath":"/dev/nvme0n1", 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "GenericPath":"/dev/ng0n1", 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "Firmware":"E3MQ000", 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "SerialNumber":"012510B47E25", 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "UsedBytes":138941087744, 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "MaximumLBA":3750748848, 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "PhysicalSize":1920383410176, 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "SectorSize":512 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: }, 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: { 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "NameSpace":1, 2026-02-17T00:10:08.099 INFO:teuthology.orchestra.run.trial196.stdout: "DevicePath":"/dev/nvme1n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "GenericPath":"/dev/ng1n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "Firmware":"E2MU200", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "SerialNumber":"25174FCD659C", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "UsedBytes":234579652608, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "MaximumLBA":1875385008, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "PhysicalSize":960197124096, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "SectorSize":512 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: }, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: { 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "NameSpace":1, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "DevicePath":"/dev/nvme2n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "GenericPath":"/dev/ng2n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "Firmware":"E3MQ000", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "SerialNumber":"012510B47DB4", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "UsedBytes":139070025728, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "MaximumLBA":3750748848, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "PhysicalSize":1920383410176, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "SectorSize":512 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: }, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: { 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "NameSpace":1, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "DevicePath":"/dev/nvme3n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "GenericPath":"/dev/ng3n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "SerialNumber":"4ddfda260f8425d85933", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "SectorSize":512 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: }, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: { 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "NameSpace":1, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "DevicePath":"/dev/nvme4n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "GenericPath":"/dev/ng4n1", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "SerialNumber":"6d0b3fa2fbc4e2ac8d12", 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:08.100 INFO:teuthology.orchestra.run.trial196.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "SectorSize":512 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: }, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: { 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "NameSpace":1, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "DevicePath":"/dev/nvme5n1", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "GenericPath":"/dev/ng5n1", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "SerialNumber":"e00fb1400837f5be28fa", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "SectorSize":512 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: }, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: { 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "NameSpace":1, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "DevicePath":"/dev/nvme6n1", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "GenericPath":"/dev/ng6n1", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "Firmware":"5.14.0-6", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "ModelNumber":"Linux", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "SerialNumber":"ef5249703d03f51e94d3", 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "UsedBytes":751619276800, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "MaximumLBA":1468006400, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "PhysicalSize":751619276800, 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: "SectorSize":512 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: } 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout: ] 2026-02-17T00:10:08.101 INFO:teuthology.orchestra.run.trial196.stdout:} 2026-02-17T00:10:08.102 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=0 bs=1 count=4096 2026-02-17T00:10:08.169 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:08.170 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:08.170 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00444406 s, 922 kB/s 2026-02-17T00:10:08.173 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s0 /dev/nvme3n1 2026-02-17T00:10:08.243 INFO:teuthology.orchestra.run.trial196.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:08.243 INFO:teuthology.orchestra.run.trial196.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:08.244 INFO:teuthology.orchestra.run.trial196.stdout:00000016 2026-02-17T00:10:08.245 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:08.315 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:08.315 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:08.315 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00440916 s, 929 kB/s 2026-02-17T00:10:08.316 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s1073741824 /dev/nvme3n1 2026-02-17T00:10:08.380 INFO:teuthology.orchestra.run.trial196.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:08.380 INFO:teuthology.orchestra.run.trial196.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:08.380 INFO:teuthology.orchestra.run.trial196.stdout:40000016 2026-02-17T00:10:08.381 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:08.450 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:08.450 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:08.450 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00487348 s, 840 kB/s 2026-02-17T00:10:08.452 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s10737418240 /dev/nvme3n1 2026-02-17T00:10:08.515 INFO:teuthology.orchestra.run.trial196.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:08.515 INFO:teuthology.orchestra.run.trial196.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:08.515 INFO:teuthology.orchestra.run.trial196.stdout:280000016 2026-02-17T00:10:08.517 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=0 bs=1 count=4096 2026-02-17T00:10:08.583 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:08.583 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:08.583 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00459211 s, 892 kB/s 2026-02-17T00:10:08.584 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s0 /dev/nvme4n1 2026-02-17T00:10:08.648 INFO:teuthology.orchestra.run.trial196.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:08.648 INFO:teuthology.orchestra.run.trial196.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:08.648 INFO:teuthology.orchestra.run.trial196.stdout:00000016 2026-02-17T00:10:08.649 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:08.715 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:08.715 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:08.715 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00471746 s, 868 kB/s 2026-02-17T00:10:08.717 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s1073741824 /dev/nvme4n1 2026-02-17T00:10:08.780 INFO:teuthology.orchestra.run.trial196.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:08.780 INFO:teuthology.orchestra.run.trial196.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:08.780 INFO:teuthology.orchestra.run.trial196.stdout:40000016 2026-02-17T00:10:08.782 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:08.850 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:08.850 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:08.850 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0050405 s, 813 kB/s 2026-02-17T00:10:08.852 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s10737418240 /dev/nvme4n1 2026-02-17T00:10:08.918 INFO:teuthology.orchestra.run.trial196.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:08.918 INFO:teuthology.orchestra.run.trial196.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:08.918 INFO:teuthology.orchestra.run.trial196.stdout:280000016 2026-02-17T00:10:08.919 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=0 bs=1 count=4096 2026-02-17T00:10:08.986 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:08.986 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:08.986 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00500048 s, 819 kB/s 2026-02-17T00:10:08.988 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s0 /dev/nvme5n1 2026-02-17T00:10:09.050 INFO:teuthology.orchestra.run.trial196.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:09.050 INFO:teuthology.orchestra.run.trial196.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:09.050 INFO:teuthology.orchestra.run.trial196.stdout:00000016 2026-02-17T00:10:09.051 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:09.118 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:09.118 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:09.118 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00465703 s, 880 kB/s 2026-02-17T00:10:09.120 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s1073741824 /dev/nvme5n1 2026-02-17T00:10:09.182 INFO:teuthology.orchestra.run.trial196.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:09.183 INFO:teuthology.orchestra.run.trial196.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:09.183 INFO:teuthology.orchestra.run.trial196.stdout:40000016 2026-02-17T00:10:09.184 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:09.250 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:09.250 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:09.250 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00442195 s, 926 kB/s 2026-02-17T00:10:09.252 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s10737418240 /dev/nvme5n1 2026-02-17T00:10:09.315 INFO:teuthology.orchestra.run.trial196.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:09.316 INFO:teuthology.orchestra.run.trial196.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:09.316 INFO:teuthology.orchestra.run.trial196.stdout:280000016 2026-02-17T00:10:09.317 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=0 bs=1 count=4096 2026-02-17T00:10:09.386 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:09.386 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:09.386 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00543715 s, 753 kB/s 2026-02-17T00:10:09.387 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s0 /dev/nvme6n1 2026-02-17T00:10:09.450 INFO:teuthology.orchestra.run.trial196.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:09.451 INFO:teuthology.orchestra.run.trial196.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:09.451 INFO:teuthology.orchestra.run.trial196.stdout:00000016 2026-02-17T00:10:09.453 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=1073741824 bs=1 count=4096 2026-02-17T00:10:09.520 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:09.520 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:09.521 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00521745 s, 785 kB/s 2026-02-17T00:10:09.522 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s1073741824 /dev/nvme6n1 2026-02-17T00:10:09.584 INFO:teuthology.orchestra.run.trial196.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:09.584 INFO:teuthology.orchestra.run.trial196.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:09.584 INFO:teuthology.orchestra.run.trial196.stdout:40000016 2026-02-17T00:10:09.585 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=10737418240 bs=1 count=4096 2026-02-17T00:10:09.652 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records in 2026-02-17T00:10:09.652 INFO:teuthology.orchestra.run.trial196.stderr:4096+0 records out 2026-02-17T00:10:09.652 INFO:teuthology.orchestra.run.trial196.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00446791 s, 917 kB/s 2026-02-17T00:10:09.654 DEBUG:teuthology.orchestra.run.trial196:> sudo hexdump -n22 -C -s10737418240 /dev/nvme6n1 2026-02-17T00:10:09.716 INFO:teuthology.orchestra.run.trial196.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T00:10:09.716 INFO:teuthology.orchestra.run.trial196.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-17T00:10:09.716 INFO:teuthology.orchestra.run.trial196.stdout:280000016 2026-02-17T00:10:09.717 INFO:tasks.nvme_loop:new_devs ['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-17T00:10:09.717 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:10:09.718 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/scratch_devs 2026-02-17T00:10:09.782 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-17T00:10:09.910 INFO:tasks.cephadm:Config: {'roleless': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'OSD_DOWN', 'CEPHADM_FAILED_DAEMON', 'but it is still running', 'PG_DEGRADED'], 'log-only-match': ['CEPHADM_'], 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'} 2026-02-17T00:10:09.911 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:10:09.913 INFO:tasks.cephadm:Cluster fsid is 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:09.913 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-17T00:10:09.913 INFO:tasks.cephadm:No mon roles; fabricating mons 2026-02-17T00:10:09.914 INFO:tasks.cephadm:Monitor IPs: {'mon.trial151': '10.20.193.151', 'mon.trial196': '10.20.193.196'} 2026-02-17T00:10:09.914 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-17T00:10:09.914 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname $(hostname -s) 2026-02-17T00:10:09.939 DEBUG:teuthology.orchestra.run.trial196:> sudo hostname $(hostname -s) 2026-02-17T00:10:09.964 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-17T00:10:09.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:10:10.112 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'ref': 'wip-squid-pr-67199-kefu-1', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-08 09:09:39.435166', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-680-g05b55d19', 'package_manager_version': '19.2.3-680.g05b55d19', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2857/', 'root_build_cause': '', 'node_name': '10.20.192.93+toko03', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-17T00:10:10.258 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-squid-pr-67199-kefu-1, sha1 05b55d192f002ad5df41409624b8d176527d0841 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:10:10.260 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-17T00:10:10.260 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-17T00:10:10.260 DEBUG:teuthology.orchestra.run.trial151:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T00:10:11.088 INFO:teuthology.orchestra.run.trial151.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 17 00:10 /home/ubuntu/cephtest/cephadm 2026-02-17T00:10:11.089 DEBUG:teuthology.orchestra.run.trial196:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T00:10:11.925 INFO:teuthology.orchestra.run.trial196.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 17 00:10 /home/ubuntu/cephtest/cephadm 2026-02-17T00:10:11.925 DEBUG:teuthology.orchestra.run.trial151:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T00:10:11.944 DEBUG:teuthology.orchestra.run.trial196:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T00:10:11.978 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 on all hosts... 2026-02-17T00:10:11.978 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-17T00:10:11.986 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-17T00:10:12.134 INFO:teuthology.orchestra.run.trial151.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-17T00:10:12.148 INFO:teuthology.orchestra.run.trial196.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-17T00:10:20.122 INFO:teuthology.orchestra.run.trial151.stdout:{ 2026-02-17T00:10:20.123 INFO:teuthology.orchestra.run.trial151.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-17T00:10:20.123 INFO:teuthology.orchestra.run.trial151.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-17T00:10:20.123 INFO:teuthology.orchestra.run.trial151.stdout: "repo_digests": [ 2026-02-17T00:10:20.123 INFO:teuthology.orchestra.run.trial151.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-17T00:10:20.123 INFO:teuthology.orchestra.run.trial151.stdout: ] 2026-02-17T00:10:20.123 INFO:teuthology.orchestra.run.trial151.stdout:} 2026-02-17T00:10:20.163 INFO:teuthology.orchestra.run.trial196.stdout:{ 2026-02-17T00:10:20.163 INFO:teuthology.orchestra.run.trial196.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-17T00:10:20.163 INFO:teuthology.orchestra.run.trial196.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-17T00:10:20.163 INFO:teuthology.orchestra.run.trial196.stdout: "repo_digests": [ 2026-02-17T00:10:20.163 INFO:teuthology.orchestra.run.trial196.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-17T00:10:20.163 INFO:teuthology.orchestra.run.trial196.stdout: ] 2026-02-17T00:10:20.164 INFO:teuthology.orchestra.run.trial196.stdout:} 2026-02-17T00:10:20.181 DEBUG:teuthology.orchestra.run.trial151:> sudo mkdir -p /etc/ceph 2026-02-17T00:10:20.206 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /etc/ceph 2026-02-17T00:10:20.247 DEBUG:teuthology.orchestra.run.trial151:> sudo chmod 777 /etc/ceph 2026-02-17T00:10:20.272 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 777 /etc/ceph 2026-02-17T00:10:20.311 INFO:tasks.cephadm:Writing seed config... 2026-02-17T00:10:20.313 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-17T00:10:20.313 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-17T00:10:20.313 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-17T00:10:20.314 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-17T00:10:20.314 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-17T00:10:20.314 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-17T00:10:20.314 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-17T00:10:20.314 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-17T00:10:20.315 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:20.315 DEBUG:teuthology.orchestra.run.trial151:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T00:10:20.333 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 05b70b75-0b95-11f1-8c5c-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-17T00:10:20.334 DEBUG:teuthology.orchestra.run.trial151:mon.trial151> sudo journalctl -f -n 0 -u ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151.service 2026-02-17T00:10:20.375 INFO:tasks.cephadm:Bootstrapping... 2026-02-17T00:10:20.375 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 -v bootstrap --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 10.20.193.151 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:10:20.510 INFO:teuthology.orchestra.run.trial151.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:10:20.511 INFO:teuthology.orchestra.run.trial151.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841', '-v', 'bootstrap', '--fsid', '05b70b75-0b95-11f1-8c5c-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '10.20.193.151', '--skip-admin-label'] 2026-02-17T00:10:20.511 INFO:teuthology.orchestra.run.trial151.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-17T00:10:20.511 INFO:teuthology.orchestra.run.trial151.stdout:Verifying podman|docker is present... 2026-02-17T00:10:20.527 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stdout 5.6.0 2026-02-17T00:10:20.527 INFO:teuthology.orchestra.run.trial151.stdout:Verifying lvm2 is present... 2026-02-17T00:10:20.527 INFO:teuthology.orchestra.run.trial151.stdout:Verifying time synchronization is in place... 2026-02-17T00:10:20.533 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T00:10:20.533 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T00:10:20.539 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T00:10:20.539 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout inactive 2026-02-17T00:10:20.545 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout enabled 2026-02-17T00:10:20.550 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout active 2026-02-17T00:10:20.550 INFO:teuthology.orchestra.run.trial151.stdout:Unit chronyd.service is enabled and running 2026-02-17T00:10:20.550 INFO:teuthology.orchestra.run.trial151.stdout:Repeating the final host check... 2026-02-17T00:10:20.566 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stdout 5.6.0 2026-02-17T00:10:20.567 INFO:teuthology.orchestra.run.trial151.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-17T00:10:20.567 INFO:teuthology.orchestra.run.trial151.stdout:systemctl is present 2026-02-17T00:10:20.567 INFO:teuthology.orchestra.run.trial151.stdout:lvcreate is present 2026-02-17T00:10:20.572 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T00:10:20.572 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T00:10:20.577 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T00:10:20.578 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout inactive 2026-02-17T00:10:20.583 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout enabled 2026-02-17T00:10:20.589 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout active 2026-02-17T00:10:20.589 INFO:teuthology.orchestra.run.trial151.stdout:Unit chronyd.service is enabled and running 2026-02-17T00:10:20.590 INFO:teuthology.orchestra.run.trial151.stdout:Host looks OK 2026-02-17T00:10:20.590 INFO:teuthology.orchestra.run.trial151.stdout:Cluster fsid: 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:20.590 INFO:teuthology.orchestra.run.trial151.stdout:Acquiring lock 139721436463360 on /run/cephadm/05b70b75-0b95-11f1-8c5c-d404e6e7d460.lock 2026-02-17T00:10:20.590 INFO:teuthology.orchestra.run.trial151.stdout:Lock 139721436463360 acquired on /run/cephadm/05b70b75-0b95-11f1-8c5c-d404e6e7d460.lock 2026-02-17T00:10:20.590 INFO:teuthology.orchestra.run.trial151.stdout:Verifying IP 10.20.193.151 port 3300 ... 2026-02-17T00:10:20.590 INFO:teuthology.orchestra.run.trial151.stdout:Verifying IP 10.20.193.151 port 6789 ... 2026-02-17T00:10:20.591 INFO:teuthology.orchestra.run.trial151.stdout:Base mon IP(s) is [10.20.193.151:3300, 10.20.193.151:6789], mon addrv is [v2:10.20.193.151:3300,v1:10.20.193.151:6789] 2026-02-17T00:10:20.593 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.151 metric 102 2026-02-17T00:10:20.593 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.151 metric 102 2026-02-17T00:10:20.593 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T00:10:20.596 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-17T00:10:20.596 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-17T00:10:20.596 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-17T00:10:20.599 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-17T00:10:20.599 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-17T00:10:20.599 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T00:10:20.599 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout inet6 fe80::8889:4c4a:73c:78c8/64 scope link noprefixroute 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6454/64 scope link 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:Mon IP `10.20.193.151` is in CIDR network `10.20.192.0/20` 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:Mon IP `10.20.193.151` is in CIDR network `10.20.192.0/20` 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-17T00:10:20.600 INFO:teuthology.orchestra.run.trial151.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-17T00:10:20.601 INFO:teuthology.orchestra.run.trial151.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-17T00:10:20.895 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stdout dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-17T00:10:20.895 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-17T00:10:20.895 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stderr Getting image source signatures 2026-02-17T00:10:20.895 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stderr Copying blob sha256:a10ade7902ac0ef76ec881f51088d9f38168c6983473ae266a7fda42a3d99f76 2026-02-17T00:10:20.895 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stderr Copying blob sha256:c92ccfe8c151fb35c12ff15a7a7de08028e120d73814d436eadc192e84f49ad9 2026-02-17T00:10:20.895 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stderr Copying config sha256:dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-17T00:10:20.895 INFO:teuthology.orchestra.run.trial151.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-17T00:10:21.008 INFO:teuthology.orchestra.run.trial151.stdout:ceph: stdout ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-17T00:10:21.008 INFO:teuthology.orchestra.run.trial151.stdout:Ceph version: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-17T00:10:21.008 INFO:teuthology.orchestra.run.trial151.stdout:Extracting ceph user uid/gid from container image... 2026-02-17T00:10:21.144 INFO:teuthology.orchestra.run.trial151.stdout:stat: stdout 167 167 2026-02-17T00:10:21.144 INFO:teuthology.orchestra.run.trial151.stdout:Creating initial keys... 2026-02-17T00:10:21.261 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph-authtool: stdout AQDtsZNp1klqDhAA9w00yV69qftFJkJvzuUq8Q== 2026-02-17T00:10:21.384 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph-authtool: stdout AQDtsZNpOWfXFRAAkWpY+/tvPErSx4QvTNbt1g== 2026-02-17T00:10:21.501 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph-authtool: stdout AQDtsZNpF2jBHBAAWAG0kr5Tr2PCUQeVX/D/4A== 2026-02-17T00:10:21.501 INFO:teuthology.orchestra.run.trial151.stdout:Creating initial monmap... 2026-02-17T00:10:21.625 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T00:10:21.625 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-17T00:10:21.625 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:21.625 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T00:10:21.626 INFO:teuthology.orchestra.run.trial151.stdout:monmaptool for trial151 [v2:10.20.193.151:3300,v1:10.20.193.151:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T00:10:21.626 INFO:teuthology.orchestra.run.trial151.stdout:setting min_mon_release = quincy 2026-02-17T00:10:21.626 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/monmaptool: set fsid to 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:21.626 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T00:10:21.626 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:21.626 INFO:teuthology.orchestra.run.trial151.stdout:Creating mon... 2026-02-17T00:10:21.737 INFO:teuthology.orchestra.run.trial151.stdout:create mon.trial151 on 2026-02-17T00:10:21.991 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-17T00:10:22.104 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460.target → /etc/systemd/system/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460.target. 2026-02-17T00:10:22.105 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460.target → /etc/systemd/system/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460.target. 2026-02-17T00:10:22.233 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151 2026-02-17T00:10:22.233 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Failed to reset failed state of unit ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151.service: Unit ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151.service not loaded. 2026-02-17T00:10:22.354 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460.target.wants/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151.service → /etc/systemd/system/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@.service. 2026-02-17T00:10:22.505 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:10:22.505 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout disabled 2026-02-17T00:10:22.510 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:10:22.510 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout inactive 2026-02-17T00:10:22.510 INFO:teuthology.orchestra.run.trial151.stdout:firewalld.service is not enabled 2026-02-17T00:10:22.510 INFO:teuthology.orchestra.run.trial151.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T00:10:22.511 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for mon to start... 2026-02-17T00:10:22.511 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for mon... 2026-02-17T00:10:22.670 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout cluster: 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout id: 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout services: 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum trial151 (age 0.134994s) 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:22.671 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout data: 2026-02-17T00:10:22.672 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-17T00:10:22.672 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-17T00:10:22.672 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-17T00:10:22.672 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout pgs: 2026-02-17T00:10:22.672 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:22.672 INFO:teuthology.orchestra.run.trial151.stdout:mon is available 2026-02-17T00:10:22.672 INFO:teuthology.orchestra.run.trial151.stdout:Assimilating anything we can from ceph.conf... 2026-02-17T00:10:22.818 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:22.818 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T00:10:22.818 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout fsid = 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.151:3300,v1:10.20.193.151:6789] 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:22.819 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T00:10:22.820 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T00:10:22.820 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T00:10:22.820 INFO:teuthology.orchestra.run.trial151.stdout:Generating new minimal ceph.conf... 2026-02-17T00:10:22.975 INFO:teuthology.orchestra.run.trial151.stdout:Restarting the monitor... 2026-02-17T00:10:23.309 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151[34948]: 2026-02-17T00:10:23.048+0000 7f24cc5a8640 -1 mon.trial151@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T00:10:23.309 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 podman[35233]: 2026-02-17 00:10:23.302308994 +0000 UTC m=+0.265545248 container died 1b457531fe6e022d15de9b3a65239019b74f833dc91cba04acfaf302a863461d (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2026-02-17T00:10:23.490 INFO:teuthology.orchestra.run.trial151.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-17T00:10:23.559 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 podman[35233]: 2026-02-17 00:10:23.310979688 +0000 UTC m=+0.274215942 container remove 1b457531fe6e022d15de9b3a65239019b74f833dc91cba04acfaf302a863461d (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.build-date=20260202, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True) 2026-02-17T00:10:23.559 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 bash[35233]: ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151 2026-02-17T00:10:23.559 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 systemd[1]: ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151.service: Deactivated successfully. 2026-02-17T00:10:23.559 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 systemd[1]: Stopped Ceph mon.trial151 for 05b70b75-0b95-11f1-8c5c-d404e6e7d460. 2026-02-17T00:10:23.559 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 systemd[1]: Starting Ceph mon.trial151 for 05b70b75-0b95-11f1-8c5c-d404e6e7d460... 2026-02-17T00:10:23.559 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 podman[35361]: 2026-02-17 00:10:23.450522083 +0000 UTC m=+0.016023183 container create 590184a2302f64b18b96550c3f1f031a177753010bbf966ecbd0b7933459a5fc (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.build-date=20260202, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841) 2026-02-17T00:10:23.559 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 podman[35361]: 2026-02-17 00:10:23.476609046 +0000 UTC m=+0.042110145 container init 590184a2302f64b18b96550c3f1f031a177753010bbf966ecbd0b7933459a5fc (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.build-date=20260202) 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 podman[35361]: 2026-02-17 00:10:23.47893081 +0000 UTC m=+0.044431899 container start 590184a2302f64b18b96550c3f1f031a177753010bbf966ecbd0b7933459a5fc (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.build-date=20260202, CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS) 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 bash[35361]: 590184a2302f64b18b96550c3f1f031a177753010bbf966ecbd0b7933459a5fc 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 podman[35361]: 2026-02-17 00:10:23.443959694 +0000 UTC m=+0.009460793 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 systemd[1]: Started Ceph mon.trial151 for 05b70b75-0b95-11f1-8c5c-d404e6e7d460. 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: set uid:gid to 167:167 (ceph:ceph) 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable), process ceph-mon, pid 2 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: pidfile_write: ignore empty --pid-file 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: load: jerasure load: lrc 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: RocksDB version: 7.9.2 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Git sha 0 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Compile date 2026-02-08 08:28:36 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: DB SUMMARY 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: DB Session ID: R0743Q8JKCWVYXG2DE0W 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: CURRENT file: CURRENT 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: IDENTITY file: IDENTITY 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: SST files in /var/lib/ceph/mon/ceph-trial151/store.db dir, Total Num: 1, files: 000008.sst 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-trial151/store.db: 000009.log size: 74657 ; 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.error_if_exists: 0 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.create_if_missing: 0 2026-02-17T00:10:23.560 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.paranoid_checks: 1 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.env: 0x5652ce9c1dc0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.fs: PosixFileSystem 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.info_log: 0x5652d0131a20 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_file_opening_threads: 16 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.statistics: (nil) 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.use_fsync: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_log_file_size: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.keep_log_file_num: 1000 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.recycle_log_file_num: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.allow_fallocate: 1 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.allow_mmap_reads: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.allow_mmap_writes: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.use_direct_reads: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.create_missing_column_families: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.db_log_dir: 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.wal_dir: 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.advise_random_on_open: 1 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.db_write_buffer_size: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.write_buffer_manager: 0x5652d0135900 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.rate_limiter: (nil) 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.wal_recovery_mode: 2 2026-02-17T00:10:23.561 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.enable_thread_tracking: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.enable_pipelined_write: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.unordered_write: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.row_cache: None 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.wal_filter: None 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.allow_ingest_behind: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.two_write_queues: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.manual_wal_flush: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.wal_compression: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.atomic_flush: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.log_readahead_size: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.best_efforts_recovery: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.allow_data_in_errors: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.db_host_id: __hostname__ 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_background_jobs: 2 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_background_compactions: -1 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_subcompactions: 1 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_total_wal_size: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_open_files: -1 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bytes_per_sync: 0 2026-02-17T00:10:23.562 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_readahead_size: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_background_flushes: -1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Compression algorithms supported: 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kZSTD supported: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kXpressCompression supported: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kBZip2Compression supported: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kLZ4Compression supported: 1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kZlibCompression supported: 1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kLZ4HCCompression supported: 1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: kSnappyCompression supported: 1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-trial151/store.db/MANIFEST-000010 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.merge_operator: 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_filter: None 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_filter_factory: None 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.sst_partitioner_factory: None 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5652d0130700) 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: cache_index_and_filter_blocks: 1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: pin_top_level_index_and_filter: 1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: index_type: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: data_block_index_type: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: index_shortening: 1 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: checksum: 4 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: no_block_cache: 0 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_cache: 0x5652d0155350 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_cache_name: BinnedLRUCache 2026-02-17T00:10:23.563 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_cache_options: 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: capacity : 536870912 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: num_shard_bits : 4 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: strict_capacity_limit : 0 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: high_pri_pool_ratio: 0.000 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_cache_compressed: (nil) 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: persistent_cache: (nil) 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_size: 4096 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_size_deviation: 10 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_restart_interval: 16 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: index_block_restart_interval: 1 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: metadata_block_size: 4096 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: partition_filters: 0 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: use_delta_encoding: 1 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: filter_policy: bloomfilter 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: whole_key_filtering: 1 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: verify_compression: 0 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: read_amp_bytes_per_bit: 0 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: format_version: 5 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: enable_index_compression: 1 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: block_align: 0 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: max_auto_readahead_size: 262144 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: prepopulate_block_cache: 0 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: initial_auto_readahead_size: 8192 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout: num_file_reads_for_auto_readahead: 2 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.write_buffer_size: 33554432 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_write_buffer_number: 2 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression: NoCompression 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression: Disabled 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.prefix_extractor: nullptr 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.num_levels: 7 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-17T00:10:23.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.level: 32767 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.strategy: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.enabled: false 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.target_file_size_base: 67108864 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-17T00:10:23.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.arena_block_size: 1048576 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.disable_auto_compactions: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.inplace_update_support: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.bloom_locality: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.max_successive_merges: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.paranoid_file_checks: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.force_consistency_checks: 1 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.report_bg_io_stats: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.ttl: 2592000 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.enable_blob_files: false 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.min_blob_size: 0 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.blob_file_size: 268435456 2026-02-17T00:10:23.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.blob_file_starting_level: 0 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-trial151/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2d3edda9-49c7-440b-aac4-d0f8212942eb 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771287023497255, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771287023497940, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 71804, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 221, "table_properties": {"data_size": 70079, "index_size": 174, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9407, "raw_average_key_size": 48, "raw_value_size": 64774, "raw_average_value_size": 337, "num_data_blocks": 8, "num_entries": 192, "num_filter_entries": 192, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771287023, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2d3edda9-49c7-440b-aac4-d0f8212942eb", "db_session_id": "R0743Q8JKCWVYXG2DE0W", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771287023497991, "job": 1, "event": "recovery_finished"} 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-trial151/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5652d0156e00 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: DB pointer 0x5652d0264000 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: ** DB Stats ** 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: ** Compaction Stats [default] ** 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: L0 2/0 72.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Sum 2/0 72.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: ** Compaction Stats [default] ** 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 142.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: 2026-02-17T00:10:23.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Cumulative compaction: 0.00 GB write, 28.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Interval compaction: 0.00 GB write, 28.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Block cache BinnedLRUCache@0x5652d0155350#2 capacity: 512.00 MB usage: 1.06 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.70 KB,0.00013411%) IndexBlock(2,0.36 KB,6.85453e-05%) Misc(1,0.00 KB,0%) 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: starting mon.trial151 rank 0 at public addrs [v2:10.20.193.151:3300/0,v1:10.20.193.151:6789/0] at bind addrs [v2:10.20.193.151:3300/0,v1:10.20.193.151:6789/0] mon_data /var/lib/ceph/mon/ceph-trial151 fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???) e1 preinit fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???).mds e1 new map 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???).mds e1 print_map 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: e1 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: btime 2026-02-17T00:10:22:510773+0000 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: legacy client fscid: -1 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout: No filesystems configured 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mon.trial151 is new leader, mons trial151 in quorum (ranks 0) 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: monmap epoch 1 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: last_changed 2026-02-17T00:10:21.595143+0000 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: created 2026-02-17T00:10:21.595143+0000 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: min_mon_release 19 (squid) 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: election_strategy: 1 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: 0: [v2:10.20.193.151:3300/0,v1:10.20.193.151:6789/0] mon.trial151 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: fsmap 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: osdmap e1: 0 total, 0 up, 0 in 2026-02-17T00:10:23.568 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:23 trial151 ceph-mon[35388]: mgrmap e1: no daemons active 2026-02-17T00:10:23.650 INFO:teuthology.orchestra.run.trial151.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-17T00:10:23.650 INFO:teuthology.orchestra.run.trial151.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:10:23.650 INFO:teuthology.orchestra.run.trial151.stdout:Creating mgr... 2026-02-17T00:10:23.650 INFO:teuthology.orchestra.run.trial151.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-17T00:10:23.651 INFO:teuthology.orchestra.run.trial151.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-17T00:10:23.651 INFO:teuthology.orchestra.run.trial151.stdout:Verifying port 0.0.0.0:8443 ... 2026-02-17T00:10:23.789 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mgr.trial151.mmtaxh 2026-02-17T00:10:23.789 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Failed to reset failed state of unit ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mgr.trial151.mmtaxh.service: Unit ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mgr.trial151.mmtaxh.service not loaded. 2026-02-17T00:10:23.907 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460.target.wants/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mgr.trial151.mmtaxh.service → /etc/systemd/system/ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@.service. 2026-02-17T00:10:24.051 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:10:24.052 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout disabled 2026-02-17T00:10:24.057 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:10:24.058 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout inactive 2026-02-17T00:10:24.058 INFO:teuthology.orchestra.run.trial151.stdout:firewalld.service is not enabled 2026-02-17T00:10:24.058 INFO:teuthology.orchestra.run.trial151.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T00:10:24.065 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:10:24.065 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout disabled 2026-02-17T00:10:24.071 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:10:24.071 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout inactive 2026-02-17T00:10:24.071 INFO:teuthology.orchestra.run.trial151.stdout:firewalld.service is not enabled 2026-02-17T00:10:24.071 INFO:teuthology.orchestra.run.trial151.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2026-02-17T00:10:24.071 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for mgr to start... 2026-02-17T00:10:24.071 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for mgr... 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "fsid": "05b70b75-0b95-11f1-8c5c-d404e6e7d460", 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 0 2026-02-17T00:10:24.237 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "trial151" 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T00:10:24.238 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T00:10:22:510773+0000", 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T00:10:22.511233+0000", 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:10:24.239 INFO:teuthology.orchestra.run.trial151.stdout:mgr not available, waiting (1/15)... 2026-02-17T00:10:24.844 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:24 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2788006780' entity='client.admin' 2026-02-17T00:10:24.844 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:24 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3758300629' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "fsid": "05b70b75-0b95-11f1-8c5c-d404e6e7d460", 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T00:10:26.393 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 0 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "trial151" 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T00:10:26.394 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T00:10:22:510773+0000", 2026-02-17T00:10:26.395 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T00:10:22.511233+0000", 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:10:26.396 INFO:teuthology.orchestra.run.trial151.stdout:mgr not available, waiting (2/15)... 2026-02-17T00:10:26.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:26 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1948993782' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T00:10:27.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: Activating manager daemon trial151.mmtaxh 2026-02-17T00:10:27.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: mgrmap e2: trial151.mmtaxh(active, starting, since 0.00243973s) 2026-02-17T00:10:27.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T00:10:27.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T00:10:27.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T00:10:27.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:10:27.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr metadata", "who": "trial151.mmtaxh", "id": "trial151.mmtaxh"}]: dispatch 2026-02-17T00:10:27.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: Manager daemon trial151.mmtaxh is now available 2026-02-17T00:10:27.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/mirror_snapshot_schedule"}]: dispatch 2026-02-17T00:10:27.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/trash_purge_schedule"}]: dispatch 2026-02-17T00:10:27.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:27.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:27.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:27 trial151 ceph-mon[35388]: from='mgr.14100 10.20.193.151:0/285344170' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:28.634 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:28.634 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:10:28.634 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "fsid": "05b70b75-0b95-11f1-8c5c-d404e6e7d460", 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 0 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:28.635 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "trial151" 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:28.636 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T00:10:28.637 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T00:10:22:510773+0000", 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:28.638 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ], 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T00:10:22.511233+0000", 2026-02-17T00:10:28.639 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T00:10:28.640 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout }, 2026-02-17T00:10:28.640 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T00:10:28.640 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:10:28.640 INFO:teuthology.orchestra.run.trial151.stdout:mgr is available 2026-02-17T00:10:28.679 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:28 trial151 ceph-mon[35388]: mgrmap e3: trial151.mmtaxh(active, since 1.00372s) 2026-02-17T00:10:28.679 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:28 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/186445737' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T00:10:28.840 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout fsid = 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.151:3300,v1:10.20.193.151:6789] 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:28.841 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T00:10:28.842 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T00:10:28.842 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 2026-02-17T00:10:28.842 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T00:10:28.842 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T00:10:28.842 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T00:10:28.842 INFO:teuthology.orchestra.run.trial151.stdout:Enabling cephadm module... 2026-02-17T00:10:29.915 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:29 trial151 ceph-mon[35388]: mgrmap e4: trial151.mmtaxh(active, since 2s) 2026-02-17T00:10:29.915 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:29 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/383857988' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-17T00:10:29.915 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:29 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3278727476' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-17T00:10:29.920 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:10:29.920 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-17T00:10:29.920 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T00:10:29.920 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "active_name": "trial151.mmtaxh", 2026-02-17T00:10:29.920 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T00:10:29.921 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:10:29.921 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for the mgr to restart... 2026-02-17T00:10:29.921 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for mgr epoch 5... 2026-02-17T00:10:30.757 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:30 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3278727476' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-17T00:10:30.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:30 trial151 ceph-mon[35388]: mgrmap e5: trial151.mmtaxh(active, since 3s) 2026-02-17T00:10:30.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:30 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1314907112' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T00:10:32.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: Active manager daemon trial151.mmtaxh restarted 2026-02-17T00:10:32.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: Activating manager daemon trial151.mmtaxh 2026-02-17T00:10:32.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: osdmap e2: 0 total, 0 up, 0 in 2026-02-17T00:10:32.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: mgrmap e6: trial151.mmtaxh(active, starting, since 0.00259886s) 2026-02-17T00:10:32.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:10:32.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr metadata", "who": "trial151.mmtaxh", "id": "trial151.mmtaxh"}]: dispatch 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: Manager daemon trial151.mmtaxh is now available 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/mirror_snapshot_schedule"}]: dispatch 2026-02-17T00:10:32.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:32 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/trash_purge_schedule"}]: dispatch 2026-02-17T00:10:33.338 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:10:33.338 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-17T00:10:33.339 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T00:10:33.339 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:10:33.339 INFO:teuthology.orchestra.run.trial151.stdout:mgr epoch 5 is available 2026-02-17T00:10:33.339 INFO:teuthology.orchestra.run.trial151.stdout:Setting orchestrator backend to cephadm... 2026-02-17T00:10:33.573 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:33 trial151 ceph-mon[35388]: Found migration_current of "None". Setting to last migration. 2026-02-17T00:10:33.573 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:33 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:33.573 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:33 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:33.573 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:33 trial151 ceph-mon[35388]: mgrmap e7: trial151.mmtaxh(active, since 1.0033s) 2026-02-17T00:10:33.754 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-17T00:10:33.754 INFO:teuthology.orchestra.run.trial151.stdout:Generating ssh key... 2026-02-17T00:10:34.180 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO/6VL//3gXeeAG5AxhZnbrORs9A8pQQvWTE215CfKpR ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:34.181 INFO:teuthology.orchestra.run.trial151.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-17T00:10:34.181 INFO:teuthology.orchestra.run.trial151.stdout:Adding key to root@localhost authorized_keys... 2026-02-17T00:10:34.182 INFO:teuthology.orchestra.run.trial151.stdout:Adding host trial151... 2026-02-17T00:10:34.415 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:33] ENGINE Bus STARTING 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:33] ENGINE Serving on http://10.20.193.151:8765 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:33] ENGINE Serving on https://10.20.193.151:7150 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:33] ENGINE Bus STARTED 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:33] ENGINE Client ('10.20.193.151', 38732) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:34.416 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:34 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:35.658 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:35 trial151 ceph-mon[35388]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:35.658 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:35 trial151 ceph-mon[35388]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:35.658 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:35 trial151 ceph-mon[35388]: Generating ssh key... 2026-02-17T00:10:35.659 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:35 trial151 ceph-mon[35388]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:35.659 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:35 trial151 ceph-mon[35388]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial151", "addr": "10.20.193.151", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:35.659 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:35 trial151 ceph-mon[35388]: mgrmap e8: trial151.mmtaxh(active, since 2s) 2026-02-17T00:10:35.915 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Added host 'trial151' with addr '10.20.193.151' 2026-02-17T00:10:35.915 INFO:teuthology.orchestra.run.trial151.stdout:Deploying mon service with default placement... 2026-02-17T00:10:36.139 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-17T00:10:36.139 INFO:teuthology.orchestra.run.trial151.stdout:Deploying mgr service with default placement... 2026-02-17T00:10:36.358 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-17T00:10:36.358 INFO:teuthology.orchestra.run.trial151.stdout:Deploying crash service with default placement... 2026-02-17T00:10:36.414 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:36 trial151 ceph-mon[35388]: Deploying cephadm binary to trial151 2026-02-17T00:10:36.415 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:36 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:36.415 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:36 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:10:36.415 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:36 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:36.415 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:36 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:36.583 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2026-02-17T00:10:36.583 INFO:teuthology.orchestra.run.trial151.stdout:Deploying ceph-exporter service with default placement... 2026-02-17T00:10:36.809 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2026-02-17T00:10:36.810 INFO:teuthology.orchestra.run.trial151.stdout:Deploying prometheus service with default placement... 2026-02-17T00:10:37.032 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2026-02-17T00:10:37.032 INFO:teuthology.orchestra.run.trial151.stdout:Deploying grafana service with default placement... 2026-02-17T00:10:37.257 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2026-02-17T00:10:37.257 INFO:teuthology.orchestra.run.trial151.stdout:Deploying node-exporter service with default placement... 2026-02-17T00:10:37.483 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2026-02-17T00:10:37.483 INFO:teuthology.orchestra.run.trial151.stdout:Deploying alertmanager service with default placement... 2026-02-17T00:10:37.532 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: Added host trial151 2026-02-17T00:10:37.532 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:37.532 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: Saving service mon spec with placement count:5 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: Saving service mgr spec with placement count:2 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: Saving service crash spec with placement * 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.533 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:37 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:37.689 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2026-02-17T00:10:38.117 INFO:teuthology.orchestra.run.trial151.stdout:Enabling the dashboard module... 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: Saving service ceph-exporter spec with placement * 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: Saving service prometheus spec with placement count:1 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: Saving service grafana spec with placement count:1 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: Saving service node-exporter spec with placement * 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: Saving service alertmanager spec with placement count:1 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='mgr.14118 10.20.193.151:0/3743114648' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:38.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1850582248' entity='client.admin' 2026-02-17T00:10:38.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1605382897' entity='client.admin' 2026-02-17T00:10:38.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:38 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1725489710' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-17T00:10:39.356 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:10:39.356 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-17T00:10:39.356 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T00:10:39.356 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "active_name": "trial151.mmtaxh", 2026-02-17T00:10:39.357 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T00:10:39.357 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:10:39.357 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for the mgr to restart... 2026-02-17T00:10:39.357 INFO:teuthology.orchestra.run.trial151.stdout:Waiting for mgr epoch 9... 2026-02-17T00:10:40.188 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:40 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1725489710' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-17T00:10:40.188 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:40 trial151 ceph-mon[35388]: mgrmap e9: trial151.mmtaxh(active, since 6s) 2026-02-17T00:10:40.188 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:40 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3293288534' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T00:10:42.097 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: Active manager daemon trial151.mmtaxh restarted 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: Activating manager daemon trial151.mmtaxh 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: osdmap e3: 0 total, 0 up, 0 in 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: mgrmap e10: trial151.mmtaxh(active, starting, since 0.00259696s) 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr metadata", "who": "trial151.mmtaxh", "id": "trial151.mmtaxh"}]: dispatch 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: Manager daemon trial151.mmtaxh is now available 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/mirror_snapshot_schedule"}]: dispatch 2026-02-17T00:10:42.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:41 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/trash_purge_schedule"}]: dispatch 2026-02-17T00:10:42.777 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout { 2026-02-17T00:10:42.777 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-17T00:10:42.777 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T00:10:42.777 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout } 2026-02-17T00:10:42.777 INFO:teuthology.orchestra.run.trial151.stdout:mgr epoch 9 is available 2026-02-17T00:10:42.777 INFO:teuthology.orchestra.run.trial151.stdout:Generating a dashboard self-signed certificate... 2026-02-17T00:10:43.154 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-17T00:10:43.155 INFO:teuthology.orchestra.run.trial151.stdout:Creating initial admin user... 2026-02-17T00:10:43.543 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:43.543 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:43.543 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:42] ENGINE Bus STARTING 2026-02-17T00:10:43.543 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:42] ENGINE Serving on https://10.20.193.151:7150 2026-02-17T00:10:43.543 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:42] ENGINE Client ('10.20.193.151', 52082) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T00:10:43.543 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T00:10:43.544 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: mgrmap e11: trial151.mmtaxh(active, since 1.00412s) 2026-02-17T00:10:43.544 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T00:10:43.544 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:42] ENGINE Serving on http://10.20.193.151:8765 2026-02-17T00:10:43.544 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:42] ENGINE Bus STARTED 2026-02-17T00:10:43.544 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:43.544 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:43.544 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:43 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:43.564 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$x/6XQZ4OUGDoGLhWj2m.C.vBcnCm.NlRYjld4T90O1fwUmVqUABFy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771287043, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-17T00:10:43.564 INFO:teuthology.orchestra.run.trial151.stdout:Fetching dashboard port number... 2026-02-17T00:10:43.774 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stdout 8443 2026-02-17T00:10:43.783 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T00:10:43.783 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout disabled 2026-02-17T00:10:43.789 INFO:teuthology.orchestra.run.trial151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T00:10:43.789 INFO:teuthology.orchestra.run.trial151.stdout:systemctl: stdout inactive 2026-02-17T00:10:43.789 INFO:teuthology.orchestra.run.trial151.stdout:firewalld.service is not enabled 2026-02-17T00:10:43.789 INFO:teuthology.orchestra.run.trial151.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-17T00:10:43.790 INFO:teuthology.orchestra.run.trial151.stdout:Ceph Dashboard is now available at: 2026-02-17T00:10:43.790 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:43.790 INFO:teuthology.orchestra.run.trial151.stdout: URL: https://trial151:8443/ 2026-02-17T00:10:43.790 INFO:teuthology.orchestra.run.trial151.stdout: User: admin 2026-02-17T00:10:43.790 INFO:teuthology.orchestra.run.trial151.stdout: Password: akgla2em8o 2026-02-17T00:10:43.790 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:43.790 INFO:teuthology.orchestra.run.trial151.stdout:Saving cluster configuration to /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config directory 2026-02-17T00:10:44.534 INFO:teuthology.orchestra.run.trial151.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-17T00:10:44.534 INFO:teuthology.orchestra.run.trial151.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-17T00:10:44.534 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.534 INFO:teuthology.orchestra.run.trial151.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:10:44.534 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.534 INFO:teuthology.orchestra.run.trial151.stdout:Or, if you are only running a single cluster on this host: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: ceph telemetry on 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout:For more information see: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:44.535 INFO:teuthology.orchestra.run.trial151.stdout:Bootstrap complete. 2026-02-17T00:10:44.561 INFO:tasks.cephadm:Fetching config... 2026-02-17T00:10:44.561 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:44.561 DEBUG:teuthology.orchestra.run.trial151:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-17T00:10:44.579 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-17T00:10:44.579 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:44.579 DEBUG:teuthology.orchestra.run.trial151:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-17T00:10:44.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:44 trial151 ceph-mon[35388]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:44.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:44 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:44.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:44 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2813358295' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-17T00:10:44.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:44 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1426171685' entity='client.admin' 2026-02-17T00:10:44.615 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-17T00:10:44.616 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:44.616 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/keyring of=/dev/stdout 2026-02-17T00:10:44.684 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-17T00:10:44.684 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:10:44.684 DEBUG:teuthology.orchestra.run.trial151:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-17T00:10:44.741 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-17T00:10:44.741 DEBUG:teuthology.orchestra.run.trial151:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO/6VL//3gXeeAG5AxhZnbrORs9A8pQQvWTE215CfKpR ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T00:10:44.815 INFO:teuthology.orchestra.run.trial151.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO/6VL//3gXeeAG5AxhZnbrORs9A8pQQvWTE215CfKpR ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:44.825 DEBUG:teuthology.orchestra.run.trial196:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO/6VL//3gXeeAG5AxhZnbrORs9A8pQQvWTE215CfKpR ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T00:10:44.859 INFO:teuthology.orchestra.run.trial196.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO/6VL//3gXeeAG5AxhZnbrORs9A8pQQvWTE215CfKpR ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:10:44.871 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-17T00:10:45.018 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:10:45.262 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-17T00:10:45.262 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-17T00:10:45.411 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:10:45.664 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial196 2026-02-17T00:10:45.664 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:10:45.664 DEBUG:teuthology.orchestra.run.trial196:> dd of=/etc/ceph/ceph.conf 2026-02-17T00:10:45.682 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:10:45.682 DEBUG:teuthology.orchestra.run.trial196:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:10:45.739 INFO:tasks.cephadm:Adding host trial196 to orchestrator... 2026-02-17T00:10:45.739 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph orch host add trial196 2026-02-17T00:10:45.763 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:45 trial151 ceph-mon[35388]: mgrmap e12: trial151.mmtaxh(active, since 2s) 2026-02-17T00:10:45.763 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:45 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3225566738' entity='client.admin' 2026-02-17T00:10:45.892 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:10:46.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:46.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:46.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial196", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:46.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:46.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:46.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd/host:trial151", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:10:46.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:10:46.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:46 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:10:47.727 INFO:teuthology.orchestra.run.trial151.stdout:Added host 'trial196' with addr '10.20.193.196' 2026-02-17T00:10:47.788 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: Updating trial151:/etc/ceph/ceph.conf 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: Deploying cephadm binary to trial196 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: Updating trial151:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: Updating trial151:/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: Updating trial151:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial151", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial151", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:10:48.022 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: Deploying daemon ceph-exporter.trial151 on trial151 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial151", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial151", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:10:48.023 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:47 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:48.091 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:10:48.283 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:10:48.283 INFO:teuthology.orchestra.run.trial151.stdout:[{"addr": "10.20.193.151", "hostname": "trial151", "labels": [], "status": ""}, {"addr": "10.20.193.196", "hostname": "trial196", "labels": [], "status": ""}] 2026-02-17T00:10:48.325 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-17T00:10:48.326 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd crush tunables default 2026-02-17T00:10:48.476 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:10:49.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: Deploying daemon crash.trial151 on trial151 2026-02-17T00:10:49.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: Added host trial196 2026-02-17T00:10:49.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:49.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:49.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:49.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:49.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: mgrmap e13: trial151.mmtaxh(active, since 6s) 2026-02-17T00:10:49.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:48 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/461549712' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-17T00:10:49.728 INFO:teuthology.orchestra.run.trial151.stderr:adjusted tunables profile to default 2026-02-17T00:10:49.769 INFO:tasks.cephadm:Adding mon.trial151 on trial151 2026-02-17T00:10:49.769 INFO:tasks.cephadm:Adding mon.trial196 on trial196 2026-02-17T00:10:49.769 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph orch apply mon '2;trial151:10.20.193.151=trial151;trial196:10.20.193.196=trial196' 2026-02-17T00:10:49.971 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:50.031 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:50.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: Deploying daemon node-exporter.trial151 on trial151 2026-02-17T00:10:50.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:10:50.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:50.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:50.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:50.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:50.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/461549712' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-17T00:10:50.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:49 trial151 ceph-mon[35388]: osdmap e4: 0 total, 0 up, 0 in 2026-02-17T00:10:50.453 INFO:teuthology.orchestra.run.trial196.stdout:Scheduled mon update... 2026-02-17T00:10:50.559 DEBUG:teuthology.orchestra.run.trial196:mon.trial196> sudo journalctl -f -n 0 -u ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial196.service 2026-02-17T00:10:50.560 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:10:50.560 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:10:50.738 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:50.768 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:50.996 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:50.997 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:10:50.997 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:10:51.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: Deploying daemon alertmanager.trial151 on trial151 2026-02-17T00:10:51.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:51.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-17T00:10:51.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:50 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:52.049 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:10:52.050 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:10:52.192 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:52.221 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:52.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:51 trial151 ceph-mon[35388]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;trial151:10.20.193.151=trial151;trial196:10.20.193.196=trial196", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:10:52.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:51 trial151 ceph-mon[35388]: Saving service mon spec with placement trial151:10.20.193.151=trial151;trial196:10.20.193.196=trial196;count:2 2026-02-17T00:10:52.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:51 trial151 ceph-mon[35388]: Regenerating cephadm self-signed grafana TLS certificates 2026-02-17T00:10:52.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:51 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-17T00:10:52.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:51 trial151 ceph-mon[35388]: Deploying daemon grafana.trial151 on trial151 2026-02-17T00:10:52.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:51 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/129905381' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:10:52.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:51 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:52.453 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:52.453 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:10:52.454 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:10:53.129 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:52 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/1377515715' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:10:53.508 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:10:53.509 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:10:53.651 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:53.679 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:53.900 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:53.900 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:10:53.900 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: Deploying daemon prometheus.trial151 on trial151 2026-02-17T00:10:54.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:54 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/1394793412' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:10:54.936 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:10:54.936 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:10:55.079 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:55.109 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:55.334 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:55.334 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:10:55.334 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:10:55.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:55 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/286905342' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:10:56.379 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:10:56.379 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:10:56.538 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:56.567 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:56.784 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:56.784 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:10:56.784 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:10:56.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:56 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:56.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:56 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:56.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:56 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:56.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:56 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-02-17T00:10:57.822 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:10:57.822 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:10:57.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:57 trial151 ceph-mon[35388]: from='mgr.14162 10.20.193.151:0/2678151522' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-17T00:10:57.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:57 trial151 ceph-mon[35388]: mgrmap e14: trial151.mmtaxh(active, since 14s) 2026-02-17T00:10:57.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:57 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/2449696356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:10:57.965 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:57.995 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:58.219 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:58.219 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:10:58.219 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:10:58.728 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/1174389472' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:10:59.253 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:10:59.254 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:10:59.395 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:59.425 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:10:59.653 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:10:59.653 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:10:59.654 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:10:59.746 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: Active manager daemon trial151.mmtaxh restarted 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: Activating manager daemon trial151.mmtaxh 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: osdmap e5: 0 total, 0 up, 0 in 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: mgrmap e15: trial151.mmtaxh(active, starting, since 0.00239604s) 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr metadata", "who": "trial151.mmtaxh", "id": "trial151.mmtaxh"}]: dispatch 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: Manager daemon trial151.mmtaxh is now available 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:10:59.747 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:10:59.748 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:10:59.748 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/mirror_snapshot_schedule"}]: dispatch 2026-02-17T00:10:59.748 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial151.mmtaxh/trash_purge_schedule"}]: dispatch 2026-02-17T00:10:59.748 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:10:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:00.709 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:11:00.710 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:11:00.796 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:00 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/4120279472' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:11:00.796 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:00 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:00.796 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:00 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:00.796 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:00 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:00.796 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:00 trial151 ceph-mon[35388]: mgrmap e16: trial151.mmtaxh(active, since 1.00382s) 2026-02-17T00:11:00.853 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:11:00.884 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T00:11:01.114 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:11:01.115 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:11:01.115 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:11:01.847 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:59] ENGINE Bus STARTING 2026-02-17T00:11:01.847 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: [17/Feb/2026:00:10:59] ENGINE Serving on http://10.20.193.151:8765 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: [17/Feb/2026:00:11:00] ENGINE Serving on https://10.20.193.151:7150 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: [17/Feb/2026:00:11:00] ENGINE Bus STARTED 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: [17/Feb/2026:00:11:00] ENGINE Client ('10.20.193.151', 42274) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd/host:trial151", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:01.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:01 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/2849337385' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:11:02.151 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:11:02.151 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:11:02.290 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:11:02.531 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:11:02.531 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:11:02.531 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: mgrmap e17: trial151.mmtaxh(active, since 2s) 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd/host:trial196", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial151:/etc/ceph/ceph.conf 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial196:/etc/ceph/ceph.conf 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial151:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial196:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial151:/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial196:/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial196:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Updating trial151:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial196", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial196", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: Deploying daemon ceph-exporter.trial196 on trial196 2026-02-17T00:11:02.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:02 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/2877692749' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:11:03.677 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:11:03.678 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:11:03.867 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:11:04.094 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:11:04.094 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:11:04.095 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:11:04.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial196", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial196", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: Deploying daemon crash.trial196 on trial196 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/4051116415' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:11:04.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:04 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:05.133 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:11:05.133 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:11:05.291 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:11:05.525 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:11:05.525 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":1,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:10:21.595143Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T00:11:05.525 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 1 2026-02-17T00:11:05.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: Deploying daemon node-exporter.trial196 on trial196 2026-02-17T00:11:05.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:05.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:05.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:05.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:05.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial196.ogdszw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T00:11:05.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.trial196.ogdszw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-17T00:11:05.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T00:11:05.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:05 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:06.647 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T00:11:06.647 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T00:11:06.803 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial196/config 2026-02-17T00:11:06.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: Deploying daemon mgr.trial196.ogdszw on trial196 2026-02-17T00:11:06.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/4066198455' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:11:06.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:06.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:06.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:06.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:06.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T00:11:06.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:12.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: mon.trial151 calling monitor election 2026-02-17T00:11:12.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:11:12.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.? 10.20.193.196:0/4176374032' entity='mgr.trial196.ogdszw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial196.ogdszw/crt"}]: dispatch 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: mon.trial196 calling monitor election 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: mon.trial151 is new leader, mons trial151,trial196 in quorum (ranks 0,1) 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: monmap epoch 2 2026-02-17T00:11:12.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: last_changed 2026-02-17T00:11:06.723249+0000 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: created 2026-02-17T00:10:21.595143+0000 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: min_mon_release 19 (squid) 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: election_strategy: 1 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: 0: [v2:10.20.193.151:3300/0,v1:10.20.193.151:6789/0] mon.trial151 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: 1: [v2:10.20.193.196:3300/0,v1:10.20.193.196:6789/0] mon.trial196 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: fsmap 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: osdmap e5: 0 total, 0 up, 0 in 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: mgrmap e17: trial151.mmtaxh(active, since 12s) 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: overall HEALTH_OK 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: Standby manager daemon trial196.ogdszw started 2026-02-17T00:11:12.100 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.? 10.20.193.196:0/4176374032' entity='mgr.trial196.ogdszw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-17T00:11:12.101 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.101 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.? 10.20.193.196:0/4176374032' entity='mgr.trial196.ogdszw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial196.ogdszw/key"}]: dispatch 2026-02-17T00:11:12.101 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.? 10.20.193.196:0/4176374032' entity='mgr.trial196.ogdszw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-17T00:11:12.101 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.101 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:11:12.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: mgrmap e18: trial151.mmtaxh(active, since 12s), standbys: trial196.ogdszw 2026-02-17T00:11:12.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr metadata", "who": "trial196.ogdszw", "id": "trial196.ogdszw"}]: dispatch 2026-02-17T00:11:12.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: Updating trial151:/etc/ceph/ceph.conf 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: Updating trial196:/etc/ceph/ceph.conf 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: Updating trial196:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: Updating trial151:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/config/ceph.conf 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T00:11:12.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T00:11:12.850 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:12.850 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:12.850 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.850 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:12.850 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial151.mmtaxh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T00:11:12.850 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T00:11:12.850 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:13.031 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T00:11:13.032 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":2,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","modified":"2026-02-17T00:11:06.723249Z","created":"2026-02-17T00:10:21.595143Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial151","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:3300","nonce":0},{"type":"v1","addr":"10.20.193.151:6789","nonce":0}]},"addr":"10.20.193.151:6789/0","public_addr":"10.20.193.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"trial196","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:3300","nonce":0},{"type":"v1","addr":"10.20.193.196:6789","nonce":0}]},"addr":"10.20.193.196:6789/0","public_addr":"10.20.193.196:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-17T00:11:13.032 INFO:teuthology.orchestra.run.trial196.stderr:dumped monmap epoch 2 2026-02-17T00:11:13.084 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-17T00:11:13.084 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-17T00:11:13.278 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:13.473 INFO:teuthology.orchestra.run.trial151.stdout:# minimal ceph.conf for 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:11:13.473 INFO:teuthology.orchestra.run.trial151.stdout:[global] 2026-02-17T00:11:13.473 INFO:teuthology.orchestra.run.trial151.stdout: fsid = 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:11:13.473 INFO:teuthology.orchestra.run.trial151.stdout: mon_host = [v2:10.20.193.151:3300/0,v1:10.20.193.151:6789/0] [v2:10.20.193.196:3300/0,v1:10.20.193.196:6789/0] 2026-02-17T00:11:13.516 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-17T00:11:13.517 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:11:13.517 DEBUG:teuthology.orchestra.run.trial151:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T00:11:13.545 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:11:13.545 DEBUG:teuthology.orchestra.run.trial151:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:11:13.610 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:11:13.610 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T00:11:13.638 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:11:13.638 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T00:11:13.703 INFO:tasks.cephadm:Deploying OSDs... 2026-02-17T00:11:13.703 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:11:13.703 DEBUG:teuthology.orchestra.run.trial151:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:11:13.721 DEBUG:teuthology.misc:devs=['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-17T00:11:13.721 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/nvme3n1 2026-02-17T00:11:13.779 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/nvme3n1 2026-02-17T00:11:13.779 INFO:teuthology.orchestra.run.trial151.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:13.780 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1328 Links: 1 Device type: 103,6 2026-02-17T00:11:13.780 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:13.780 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:13.780 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:46.235906176 +0000 2026-02-17T00:11:13.780 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:05.273746219 +0000 2026-02-17T00:11:13.780 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:05.273746219 +0000 2026-02-17T00:11:13.780 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:04.364885203 +0000 2026-02-17T00:11:13.781 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2026-02-17T00:11:13.844 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:11:13.844 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:11:13.844 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000164488 s, 3.1 MB/s 2026-02-17T00:11:13.845 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2026-02-17T00:11:13.902 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/nvme4n1 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/nvme4n1 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1340 Links: 1 Device type: 103,8 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:46.279906191 +0000 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:05.668355106 +0000 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:05.668355106 +0000 2026-02-17T00:11:13.959 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:04.500884981 +0000 2026-02-17T00:11:13.959 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2026-02-17T00:11:13.995 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring mon.trial151 (unknown last config time)... 2026-02-17T00:11:13.995 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring daemon mon.trial151 on trial151 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring mgr.trial151.mmtaxh (unknown last config time)... 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring daemon mgr.trial151.mmtaxh on trial151 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/724347311' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring ceph-exporter.trial151 (monmap changed)... 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial151", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring daemon ceph-exporter.trial151 on trial151 2026-02-17T00:11:13.996 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring crash.trial151 (monmap changed)... 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial151", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: Reconfiguring daemon crash.trial151 on trial151 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/244205240' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:13.997 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:13 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:14.023 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:11:14.023 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:11:14.023 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000172673 s, 3.0 MB/s 2026-02-17T00:11:14.024 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2026-02-17T00:11:14.085 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/nvme5n1 2026-02-17T00:11:14.112 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:13 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/nvme5n1 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1352 Links: 1 Device type: 103,a 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:46.325906207 +0000 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:06.067959043 +0000 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:06.067959043 +0000 2026-02-17T00:11:14.142 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:04.638884757 +0000 2026-02-17T00:11:14.142 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/nvme5n1 of=/dev/null count=1 2026-02-17T00:11:14.208 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:11:14.208 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:11:14.208 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000163636 s, 3.1 MB/s 2026-02-17T00:11:14.210 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/nvme5n1 2026-02-17T00:11:14.270 DEBUG:teuthology.orchestra.run.trial151:> stat /dev/nvme6n1 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout: File: /dev/nvme6n1 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout:Device: 6h/6d Inode: 1364 Links: 1 Device type: 103,c 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout:Access: 2026-02-17 00:10:46.369906222 +0000 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout:Modify: 2026-02-17 00:10:06.462892508 +0000 2026-02-17T00:11:14.326 INFO:teuthology.orchestra.run.trial151.stdout:Change: 2026-02-17 00:10:06.462892508 +0000 2026-02-17T00:11:14.327 INFO:teuthology.orchestra.run.trial151.stdout: Birth: 2026-02-17 00:10:04.759884559 +0000 2026-02-17T00:11:14.327 DEBUG:teuthology.orchestra.run.trial151:> sudo dd if=/dev/nvme6n1 of=/dev/null count=1 2026-02-17T00:11:14.389 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records in 2026-02-17T00:11:14.389 INFO:teuthology.orchestra.run.trial151.stderr:1+0 records out 2026-02-17T00:11:14.389 INFO:teuthology.orchestra.run.trial151.stderr:512 bytes copied, 0.000186219 s, 2.7 MB/s 2026-02-17T00:11:14.391 DEBUG:teuthology.orchestra.run.trial151:> ! mount | grep -v devtmpfs | grep -q /dev/nvme6n1 2026-02-17T00:11:14.450 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:11:14.450 DEBUG:teuthology.orchestra.run.trial196:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:11:14.468 DEBUG:teuthology.misc:devs=['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-17T00:11:14.468 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/nvme3n1 2026-02-17T00:11:14.525 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/nvme3n1 2026-02-17T00:11:14.525 INFO:teuthology.orchestra.run.trial196.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:14.525 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1328 Links: 1 Device type: 103,6 2026-02-17T00:11:14.525 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:14.525 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:14.525 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:11:01.643571921 +0000 2026-02-17T00:11:14.525 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:08.446278842 +0000 2026-02-17T00:11:14.526 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:08.446278842 +0000 2026-02-17T00:11:14.526 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:07.532290988 +0000 2026-02-17T00:11:14.526 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2026-02-17T00:11:14.588 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:11:14.588 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:11:14.588 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000169374 s, 3.0 MB/s 2026-02-17T00:11:14.590 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2026-02-17T00:11:14.646 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/nvme4n1 2026-02-17T00:11:14.702 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/nvme4n1 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1340 Links: 1 Device type: 103,8 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:11:01.684571376 +0000 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:08.847273513 +0000 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:08.847273513 +0000 2026-02-17T00:11:14.703 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:07.660289287 +0000 2026-02-17T00:11:14.704 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2026-02-17T00:11:14.765 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:11:14.765 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:11:14.765 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000166108 s, 3.1 MB/s 2026-02-17T00:11:14.766 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2026-02-17T00:11:14.824 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/nvme5n1 2026-02-17T00:11:14.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:14 trial196 ceph-mon[42270]: Reconfiguring alertmanager.trial151 (dependencies changed)... 2026-02-17T00:11:14.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:14 trial196 ceph-mon[42270]: Reconfiguring daemon alertmanager.trial151 on trial151 2026-02-17T00:11:14.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:14.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:14.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:14.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:14 trial196 ceph-mon[42270]: Reconfiguring grafana.trial151 (dependencies changed)... 2026-02-17T00:11:14.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:14 trial196 ceph-mon[42270]: Reconfiguring daemon grafana.trial151 on trial151 2026-02-17T00:11:14.879 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/nvme5n1 2026-02-17T00:11:14.879 INFO:teuthology.orchestra.run.trial196.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:14.879 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1352 Links: 1 Device type: 103,a 2026-02-17T00:11:14.879 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:14.879 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:14.879 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:11:01.726570818 +0000 2026-02-17T00:11:14.879 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:09.247268198 +0000 2026-02-17T00:11:14.880 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:09.247268198 +0000 2026-02-17T00:11:14.880 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:07.785287626 +0000 2026-02-17T00:11:14.880 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/nvme5n1 of=/dev/null count=1 2026-02-17T00:11:14.942 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:11:14.943 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:11:14.943 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000152723 s, 3.4 MB/s 2026-02-17T00:11:14.944 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/nvme5n1 2026-02-17T00:11:14.966 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:14 trial151 ceph-mon[35388]: Reconfiguring alertmanager.trial151 (dependencies changed)... 2026-02-17T00:11:14.966 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:14 trial151 ceph-mon[35388]: Reconfiguring daemon alertmanager.trial151 on trial151 2026-02-17T00:11:14.966 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:14.966 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:14.966 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:14.966 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:14 trial151 ceph-mon[35388]: Reconfiguring grafana.trial151 (dependencies changed)... 2026-02-17T00:11:14.966 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:14 trial151 ceph-mon[35388]: Reconfiguring daemon grafana.trial151 on trial151 2026-02-17T00:11:15.000 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/nvme6n1 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/nvme6n1 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1364 Links: 1 Device type: 103,c 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 00:11:01.767570273 +0000 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 00:10:09.649262856 +0000 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 00:10:09.649262856 +0000 2026-02-17T00:11:15.055 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-17 00:10:07.913285925 +0000 2026-02-17T00:11:15.055 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/nvme6n1 of=/dev/null count=1 2026-02-17T00:11:15.118 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T00:11:15.118 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T00:11:15.118 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000163614 s, 3.1 MB/s 2026-02-17T00:11:15.119 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/nvme6n1 2026-02-17T00:11:15.178 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph orch apply osd --all-available-devices 2026-02-17T00:11:15.367 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial196/config 2026-02-17T00:11:15.567 INFO:teuthology.orchestra.run.trial196.stdout:Scheduled osd.all-available-devices update... 2026-02-17T00:11:15.604 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-02-17T00:11:15.605 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:15.766 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:15.963 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:16.000 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2026-02-17T00:11:16.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: Reconfiguring prometheus.trial151 (dependencies changed)... 2026-02-17T00:11:16.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: Reconfiguring daemon prometheus.trial151 on trial151 2026-02-17T00:11:16.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial196", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T00:11:16.099 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: Reconfiguring prometheus.trial151 (dependencies changed)... 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: Reconfiguring daemon prometheus.trial151 on trial151 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial196", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T00:11:16.142 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:17.001 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:17.180 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch apply osd", "all_available_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Marking host: trial151 for OSDSpec preview refresh. 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Marking host: trial196 for OSDSpec preview refresh. 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Saving service osd.all-available-devices spec with placement * 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring ceph-exporter.trial196 (monmap changed)... 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring daemon ceph-exporter.trial196 on trial196 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2661981779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring crash.trial196 (monmap changed)... 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial196", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring daemon crash.trial196 on trial196 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring mgr.trial196.ogdszw (monmap changed)... 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial196.ogdszw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring daemon mgr.trial196.ogdszw on trial196 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.203 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring mon.trial196 (monmap changed)... 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: Reconfiguring daemon mon.trial196 on trial196 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial151:9093"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial151:3000"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial151:9095"}]: dispatch 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.204 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:16 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:11:17.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch apply osd", "all_available_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Marking host: trial151 for OSDSpec preview refresh. 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Marking host: trial196 for OSDSpec preview refresh. 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Saving service osd.all-available-devices spec with placement * 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring ceph-exporter.trial196 (monmap changed)... 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring daemon ceph-exporter.trial196 on trial196 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2661981779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.364 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring crash.trial196 (monmap changed)... 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial196", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring daemon crash.trial196 on trial196 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring mgr.trial196.ogdszw (monmap changed)... 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial196.ogdszw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring daemon mgr.trial196.ogdszw on trial196 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.365 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring mon.trial196 (monmap changed)... 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: Reconfiguring daemon mon.trial196 on trial196 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial151:9093"}]: dispatch 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T00:11:17.366 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial151:3000"}]: dispatch 2026-02-17T00:11:17.367 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.367 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T00:11:17.367 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial151:9095"}]: dispatch 2026-02-17T00:11:17.367 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:17.367 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:16 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:11:17.387 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:17.434 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2026-02-17T00:11:18.435 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:18.460 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial151:9093"}]: dispatch 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial151:3000"}]: dispatch 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial151:9095"}]: dispatch 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1057085694' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:18.462 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:11:18.463 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:18.591 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:18.600 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial151:9093"}]: dispatch 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial151:3000"}]: dispatch 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial151:9095"}]: dispatch 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.601 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1057085694' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:11:18.602 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:18.798 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:18.835 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":6,"num_osds":1,"num_up_osds":0,"osd_up_since":0,"num_in_osds":1,"osd_in_since":1771287078,"num_remapped_pgs":0} 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/3507088391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d59ff3-1a72-4da3-afd6-076a2168f4a5"}]: dispatch 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d59ff3-1a72-4da3-afd6-076a2168f4a5"}]: dispatch 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62d59ff3-1a72-4da3-afd6-076a2168f4a5"}]': finished 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: osdmap e6: 1 total, 0 up, 1 in 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3405076753' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1932354462' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "557c1534-392c-4db7-9e25-2c6d3968c2b5"}]: dispatch 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1932354462' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "557c1534-392c-4db7-9e25-2c6d3968c2b5"}]': finished 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:19.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:19 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:19.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/3507088391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d59ff3-1a72-4da3-afd6-076a2168f4a5"}]: dispatch 2026-02-17T00:11:19.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d59ff3-1a72-4da3-afd6-076a2168f4a5"}]: dispatch 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62d59ff3-1a72-4da3-afd6-076a2168f4a5"}]': finished 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: osdmap e6: 1 total, 0 up, 1 in 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3405076753' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1932354462' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "557c1534-392c-4db7-9e25-2c6d3968c2b5"}]: dispatch 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1932354462' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "557c1534-392c-4db7-9e25-2c6d3968c2b5"}]': finished 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:19 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:19.836 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:19.993 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:20.189 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:20.228 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":7,"num_osds":2,"num_up_osds":0,"osd_up_since":0,"num_in_osds":2,"osd_in_since":1771287078,"num_remapped_pgs":0} 2026-02-17T00:11:20.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:20 trial151 ceph-mon[35388]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:20.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:20 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/114832096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:20.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:20 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1672803624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:20.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:20 trial196 ceph-mon[42270]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:20.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:20 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/114832096' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:20.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:20 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1672803624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:21.230 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:21.384 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:21.432 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:21 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/454006312' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:21.585 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:21.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:21 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/454006312' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:21.622 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":7,"num_osds":2,"num_up_osds":0,"osd_up_since":0,"num_in_osds":2,"osd_in_since":1771287078,"num_remapped_pgs":0} 2026-02-17T00:11:22.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:22 trial151 ceph-mon[35388]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:22.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:22 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3558580529' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:22.560 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:22 trial196 ceph-mon[42270]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:22.560 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:22 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3558580529' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:22.622 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:22.777 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:22.974 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:23.011 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":9,"num_osds":4,"num_up_osds":0,"osd_up_since":0,"num_in_osds":4,"osd_in_since":1771287082,"num_remapped_pgs":0} 2026-02-17T00:11:23.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1884812455' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e6954ce-86f3-4666-83c4-68219a265097"}]: dispatch 2026-02-17T00:11:23.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1884812455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e6954ce-86f3-4666-83c4-68219a265097"}]': finished 2026-02-17T00:11:23.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: osdmap e8: 3 total, 0 up, 3 in 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/2015950793' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "906a810e-6536-465f-8af2-e44106b0c617"}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "906a810e-6536-465f-8af2-e44106b0c617"}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "906a810e-6536-465f-8af2-e44106b0c617"}]': finished 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: osdmap e9: 4 total, 0 up, 4 in 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:23.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3946377350' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:23.350 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:23 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1488527734' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:23.453 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1884812455' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e6954ce-86f3-4666-83c4-68219a265097"}]: dispatch 2026-02-17T00:11:23.453 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1884812455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e6954ce-86f3-4666-83c4-68219a265097"}]': finished 2026-02-17T00:11:23.453 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: osdmap e8: 3 total, 0 up, 3 in 2026-02-17T00:11:23.453 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:23.453 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:23.453 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:23.453 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/2015950793' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "906a810e-6536-465f-8af2-e44106b0c617"}]: dispatch 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "906a810e-6536-465f-8af2-e44106b0c617"}]: dispatch 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "906a810e-6536-465f-8af2-e44106b0c617"}]': finished 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: osdmap e9: 4 total, 0 up, 4 in 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3946377350' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:23.454 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:23 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1488527734' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:24.013 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:24.173 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:24.289 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:24 trial151 ceph-mon[35388]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:24.289 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:24 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/1249616712' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:24.370 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:24.424 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":9,"num_osds":4,"num_up_osds":0,"osd_up_since":0,"num_in_osds":4,"osd_in_since":1771287082,"num_remapped_pgs":0} 2026-02-17T00:11:24.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:24 trial196 ceph-mon[42270]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:24.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:24 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/1249616712' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:25.425 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:25.447 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:25 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2146350815' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:25.575 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:25.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:25 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2146350815' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:25.770 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:25.804 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":9,"num_osds":4,"num_up_osds":0,"osd_up_since":0,"num_in_osds":4,"osd_in_since":1771287082,"num_remapped_pgs":0} 2026-02-17T00:11:26.458 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:26 trial151 ceph-mon[35388]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:26.458 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:26 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3736205860' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:26.507 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:26 trial196 ceph-mon[42270]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:26.507 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:26 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3736205860' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:26.805 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:26.962 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:27.162 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:27.199 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":11,"num_osds":6,"num_up_osds":0,"osd_up_since":0,"num_in_osds":6,"osd_in_since":1771287086,"num_remapped_pgs":0} 2026-02-17T00:11:27.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/450226044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c841aa1-3cf9-4aad-bece-213c8a23b24c"}]: dispatch 2026-02-17T00:11:27.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/450226044' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c841aa1-3cf9-4aad-bece-213c8a23b24c"}]': finished 2026-02-17T00:11:27.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: osdmap e10: 5 total, 0 up, 5 in 2026-02-17T00:11:27.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:27.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/178909616' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d576014-c0b3-4aac-992e-bbf99f35171e"}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d576014-c0b3-4aac-992e-bbf99f35171e"}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d576014-c0b3-4aac-992e-bbf99f35171e"}]': finished 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: osdmap e11: 6 total, 0 up, 6 in 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:27.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:27.350 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:27.350 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:27.350 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/891561086' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:27.350 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:27 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/4073192861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:27.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/450226044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c841aa1-3cf9-4aad-bece-213c8a23b24c"}]: dispatch 2026-02-17T00:11:27.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/450226044' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c841aa1-3cf9-4aad-bece-213c8a23b24c"}]': finished 2026-02-17T00:11:27.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: osdmap e10: 5 total, 0 up, 5 in 2026-02-17T00:11:27.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:27.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/178909616' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d576014-c0b3-4aac-992e-bbf99f35171e"}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d576014-c0b3-4aac-992e-bbf99f35171e"}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d576014-c0b3-4aac-992e-bbf99f35171e"}]': finished 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: osdmap e11: 6 total, 0 up, 6 in 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:27.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:27.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:27.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/891561086' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:27.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:27 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/4073192861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:28.201 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:28.361 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:28.478 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:28 trial151 ceph-mon[35388]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:28.478 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:28 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/4157736483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:28.563 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:28.598 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":11,"num_osds":6,"num_up_osds":0,"osd_up_since":0,"num_in_osds":6,"osd_in_since":1771287086,"num_remapped_pgs":0} 2026-02-17T00:11:28.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:28 trial196 ceph-mon[42270]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:28.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:28 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/4157736483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:29.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:29 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/124171709' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:29.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:29 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:29.599 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:29.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:29 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/124171709' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:29.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:29 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:29.755 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:29.947 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:29.983 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":11,"num_osds":6,"num_up_osds":0,"osd_up_since":0,"num_in_osds":6,"osd_in_since":1771287086,"num_remapped_pgs":0} 2026-02-17T00:11:30.456 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:30 trial196 ceph-mon[42270]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:30.456 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:30 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/65449256' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:30.457 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:30 trial151 ceph-mon[35388]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:30.457 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:30 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/65449256' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:30.984 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:31.141 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:31.341 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/1629253778' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d95269-f269-48ad-9d34-13627ef11613"}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d95269-f269-48ad-9d34-13627ef11613"}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9d95269-f269-48ad-9d34-13627ef11613"}]': finished 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: osdmap e12: 7 total, 0 up, 7 in 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3256617286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "266718b8-2dc7-458b-956f-62a2480f3fe3"}]: dispatch 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3256617286' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "266718b8-2dc7-458b-956f-62a2480f3fe3"}]': finished 2026-02-17T00:11:31.341 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: osdmap e13: 8 total, 0 up, 8 in 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/3688540259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:31.342 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:31 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2474855247' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:31.377 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:31.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/1629253778' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d95269-f269-48ad-9d34-13627ef11613"}]: dispatch 2026-02-17T00:11:31.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9d95269-f269-48ad-9d34-13627ef11613"}]: dispatch 2026-02-17T00:11:31.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9d95269-f269-48ad-9d34-13627ef11613"}]': finished 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: osdmap e12: 7 total, 0 up, 7 in 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3256617286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "266718b8-2dc7-458b-956f-62a2480f3fe3"}]: dispatch 2026-02-17T00:11:31.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3256617286' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "266718b8-2dc7-458b-956f-62a2480f3fe3"}]': finished 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: osdmap e13: 8 total, 0 up, 8 in 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/3688540259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:31.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:31 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2474855247' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:11:32.379 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:32.541 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:32.564 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:32 trial151 ceph-mon[35388]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:32.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:32 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/549661645' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:32.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:32 trial196 ceph-mon[42270]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:32.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:32 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/549661645' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:32.739 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:32.777 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:33.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:33 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2377147760' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:33.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:33 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2377147760' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:33.779 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:33.935 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:34.128 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:34.164 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:34.229 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:34 trial196 ceph-mon[42270]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:34.229 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:34 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3131754945' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:34.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:34 trial151 ceph-mon[35388]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:34.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:34 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3131754945' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:35.165 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:35.326 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:35.350 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:35 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T00:11:35.350 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:35 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:35.440 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:35 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T00:11:35.440 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:35 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:35.536 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:35.575 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:36.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:36 trial151 ceph-mon[35388]: Deploying daemon osd.0 on trial196 2026-02-17T00:11:36.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:36 trial151 ceph-mon[35388]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:36.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:36 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T00:11:36.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:36 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:36.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:36 trial151 ceph-mon[35388]: Deploying daemon osd.1 on trial151 2026-02-17T00:11:36.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:36 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3777254498' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:36.576 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:36.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:36 trial196 ceph-mon[42270]: Deploying daemon osd.0 on trial196 2026-02-17T00:11:36.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:36 trial196 ceph-mon[42270]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:36.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:36 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T00:11:36.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:36 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:36.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:36 trial196 ceph-mon[42270]: Deploying daemon osd.1 on trial151 2026-02-17T00:11:36.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:36 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3777254498' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:36.744 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:36.951 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:36.989 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:37.990 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:38.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: Deploying daemon osd.3 on trial196 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/12616966' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T00:11:38.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:37 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:38.143 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:38.148 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.148 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: Deploying daemon osd.3 on trial196 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/12616966' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T00:11:38.149 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:37 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:38.345 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:38.392 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:39.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:38 trial196 ceph-mon[42270]: Deploying daemon osd.2 on trial151 2026-02-17T00:11:39.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:38 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1560005169' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:39.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:38 trial151 ceph-mon[35388]: Deploying daemon osd.2 on trial151 2026-02-17T00:11:39.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:38 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1560005169' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:39.393 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:39.553 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:39.753 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:39.792 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:40.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:40.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: Deploying daemon osd.5 on trial196 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/969211491' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-17T00:11:40.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:40 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:40.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:40.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-17T00:11:40.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:40.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: Deploying daemon osd.5 on trial196 2026-02-17T00:11:40.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/969211491' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:40.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:40.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-17T00:11:40.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:40 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:40.793 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:41.007 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:41.207 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:41.247 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:41.492 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:41 trial151 ceph-mon[35388]: Deploying daemon osd.4 on trial151 2026-02-17T00:11:41.493 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:41 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3183302172' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:41.541 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:41 trial196 ceph-mon[42270]: Deploying daemon osd.4 on trial151 2026-02-17T00:11:41.541 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:41 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3183302172' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:42.249 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:42.409 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:42.431 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:42 trial196 ceph-mon[42270]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:42.431 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:42 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:42.431 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:42 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:42.431 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:42 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-17T00:11:42.431 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:42 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:42.433 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:42 trial151 ceph-mon[35388]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:42.433 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:42 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:42.433 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:42 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:42.434 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:42 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-17T00:11:42.434 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:42 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:42.620 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:42.662 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:43.472 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: Deploying daemon osd.6 on trial196 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='osd.0 [v2:10.20.193.196:6800/3588585242,v1:10.20.193.196:6801/3588585242]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/4036420087' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:43.473 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:43 trial151 ceph-mon[35388]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T00:11:43.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: Deploying daemon osd.6 on trial196 2026-02-17T00:11:43.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='osd.0 [v2:10.20.193.196:6800/3588585242,v1:10.20.193.196:6801/3588585242]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T00:11:43.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T00:11:43.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/4036420087' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:43.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:43.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:43.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-17T00:11:43.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:43.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:43 trial196 ceph-mon[42270]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T00:11:43.664 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:43.836 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:44.046 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:44.097 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":14,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:44.590 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: Deploying daemon osd.7 on trial151 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='osd.0 [v2:10.20.193.196:6800/3588585242,v1:10.20.193.196:6801/3588585242]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: osdmap e14: 8 total, 0 up, 8 in 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:44.591 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/728245482' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:44.592 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:44 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:44.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: Deploying daemon osd.7 on trial151 2026-02-17T00:11:44.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='osd.0 [v2:10.20.193.196:6800/3588585242,v1:10.20.193.196:6801/3588585242]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: osdmap e14: 8 total, 0 up, 8 in 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:44.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:44.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:44.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:44.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/728245482' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:44.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:44.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:44.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:44 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:45.098 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:45.266 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: osdmap e15: 8 total, 0 up, 8 in 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:45.372 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='osd.3 [v2:10.20.193.196:6808/2016689849,v1:10.20.193.196:6809/2016689849]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:45.373 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:45 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:45.466 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:45.524 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":16,"num_osds":8,"num_up_osds":2,"osd_up_since":1771287105,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:45.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:45.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:45.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: osdmap e15: 8 total, 0 up, 8 in 2026-02-17T00:11:45.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:45.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='osd.3 [v2:10.20.193.196:6808/2016689849,v1:10.20.193.196:6809/2016689849]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:45.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:45 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:46.525 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:46.550 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:46.550 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:46.550 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: OSD bench result of 121508.533301 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='osd.3 [v2:10.20.193.196:6808/2016689849,v1:10.20.193.196:6809/2016689849]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416] boot 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: osd.0 [v2:10.20.193.196:6800/3588585242,v1:10.20.193.196:6801/3588585242] boot 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: osdmap e16: 8 total, 2 up, 8 in 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1938042373' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:46.551 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:46 trial151 ceph-mon[35388]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T00:11:46.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:46.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:46.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:46.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:46.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: OSD bench result of 121508.533301 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:46.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T00:11:46.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='osd.3 [v2:10.20.193.196:6808/2016689849,v1:10.20.193.196:6809/2016689849]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: osd.1 [v2:10.20.193.151:6802/1536115416,v1:10.20.193.151:6803/1536115416] boot 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: osd.0 [v2:10.20.193.196:6800/3588585242,v1:10.20.193.196:6801/3588585242] boot 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: osdmap e16: 8 total, 2 up, 8 in 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:46.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:46.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:46.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:46.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:46.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:46.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:46.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1938042373' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:46.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:46 trial196 ceph-mon[42270]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T00:11:46.689 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:46.895 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:46.956 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":17,"num_osds":8,"num_up_osds":2,"osd_up_since":1771287105,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:47.354 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: osdmap e17: 8 total, 2 up, 8 in 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:47.355 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:47.356 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:47.429 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:47.429 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.429 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.429 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:11:47.429 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/756856620' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:47.429 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='osd.5 [v2:10.20.193.196:6816/1615388391,v1:10.20.193.196:6817/1615388391]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T00:11:47.430 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T00:11:47.430 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.430 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:47 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: osdmap e17: 8 total, 2 up, 8 in 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/756856620' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='osd.5 [v2:10.20.193.196:6816/1615388391,v1:10.20.193.196:6817/1615388391]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:47 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:47.958 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:48.123 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:48.318 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:48.356 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":18,"num_osds":8,"num_up_osds":3,"osd_up_since":1771287107,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='osd.5 [v2:10.20.193.196:6816/1615388391,v1:10.20.193.196:6817/1615388391]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: osd.3 [v2:10.20.193.196:6808/2016689849,v1:10.20.193.196:6809/2016689849] boot 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: osdmap e18: 8 total, 3 up, 8 in 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:48.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-17T00:11:48.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:48 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2935152261' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='osd.5 [v2:10.20.193.196:6816/1615388391,v1:10.20.193.196:6817/1615388391]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: osd.3 [v2:10.20.193.196:6808/2016689849,v1:10.20.193.196:6809/2016689849] boot 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: osdmap e18: 8 total, 3 up, 8 in 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T00:11:48.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-17T00:11:48.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:48 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2935152261' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:49.357 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:49.517 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:49.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:49.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: OSD bench result of 111572.932139 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.2. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754] boot 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: osdmap e19: 8 total, 4 up, 8 in 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:49.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: Detected new or changed devices on trial196 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: Adjusting osd_memory_target on trial196 to 20467M 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='osd.6 [v2:10.20.193.196:6824/140611127,v1:10.20.193.196:6825/140611127]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T00:11:49.616 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T00:11:49.617 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:49 trial196 ceph-mon[42270]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:49.633 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:49.633 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: OSD bench result of 111572.932139 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.2. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: osd.2 [v2:10.20.193.151:6810/2286637754,v1:10.20.193.151:6811/2286637754] boot 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: osdmap e19: 8 total, 4 up, 8 in 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:49.634 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: Detected new or changed devices on trial196 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: Adjusting osd_memory_target on trial196 to 20467M 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.635 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='osd.6 [v2:10.20.193.196:6824/140611127,v1:10.20.193.196:6825/140611127]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T00:11:49.636 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:49 trial151 ceph-mon[35388]: from='osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101]' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:49.715 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:49.754 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":20,"num_osds":8,"num_up_osds":5,"osd_up_since":1771287109,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:50.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:50.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:50.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: OSD bench result of 103700.073945 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.5. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:50.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: Detected new or changed devices on trial151 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: Adjusting osd_memory_target on trial151 to 19699M 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: osd.5 [v2:10.20.193.196:6816/1615388391,v1:10.20.193.196:6817/1615388391] boot 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: osdmap e20: 8 total, 5 up, 8 in 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:50.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='osd.6 [v2:10.20.193.196:6824/140611127,v1:10.20.193.196:6825/140611127]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1902296885' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101] boot 2026-02-17T00:11:50.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:50 trial196 ceph-mon[42270]: osdmap e21: 8 total, 6 up, 8 in 2026-02-17T00:11:50.741 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:50.741 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:50.741 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: OSD bench result of 103700.073945 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.5. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:50.741 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: Detected new or changed devices on trial151 2026-02-17T00:11:50.741 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: Adjusting osd_memory_target on trial151 to 19699M 2026-02-17T00:11:50.741 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: osd.5 [v2:10.20.193.196:6816/1615388391,v1:10.20.193.196:6817/1615388391] boot 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: osdmap e20: 8 total, 5 up, 8 in 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='osd.6 [v2:10.20.193.196:6824/140611127,v1:10.20.193.196:6825/140611127]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:50.742 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial196", "root=default"]}]: dispatch 2026-02-17T00:11:50.743 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1902296885' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:50.743 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T00:11:50.743 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial196", "root=default"]}]': finished 2026-02-17T00:11:50.743 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: osd.4 [v2:10.20.193.151:6818/2571187101,v1:10.20.193.151:6819/2571187101] boot 2026-02-17T00:11:50.743 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:50 trial151 ceph-mon[35388]: osdmap e21: 8 total, 6 up, 8 in 2026-02-17T00:11:50.755 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:50.914 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:51.108 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:51.167 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":21,"num_osds":8,"num_up_osds":6,"osd_up_since":1771287110,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:51.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:51.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:51.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:51.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:51.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:51.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:51.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-17T00:11:51.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:51 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/355084228' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-17T00:11:51.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:51 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/355084228' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:52.169 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:52.325 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:52.527 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:52.527 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:52.527 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: OSD bench result of 138506.917589 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.6. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: pgmap v35: 1 pgs: 1 unknown; 0 B data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: osd.6 [v2:10.20.193.196:6824/140611127,v1:10.20.193.196:6825/140611127] boot 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: osdmap e22: 8 total, 7 up, 8 in 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:52.528 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:52.569 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":23,"num_osds":8,"num_up_osds":7,"osd_up_since":1771287111,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:52.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:52.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: OSD bench result of 138506.917589 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.6. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: pgmap v35: 1 pgs: 1 unknown; 0 B data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: osd.6 [v2:10.20.193.196:6824/140611127,v1:10.20.193.196:6825/140611127] boot 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: osdmap e22: 8 total, 7 up, 8 in 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial151", "root=default"]}]: dispatch 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T00:11:52.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58170]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58170]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58170]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58174]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58174]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:11:53.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:52 trial196 sudo[58174]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72068]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72068]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72068]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T00:11:53.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:52 trial151 sudo[72072]: pam_unix(sudo:session): session closed for user root 2026-02-17T00:11:53.570 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T00:11:53.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: osdmap e23: 8 total, 7 up, 8 in 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3327754012' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T00:11:53.615 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:53 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.735 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:53.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial151", "root=default"]}]': finished 2026-02-17T00:11:53.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: osdmap e23: 8 total, 7 up, 8 in 2026-02-17T00:11:53.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:53.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:53.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3327754012' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:53.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.758 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial151"}]: dispatch 2026-02-17T00:11:53.759 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "mon metadata", "id": "trial196"}]: dispatch 2026-02-17T00:11:53.760 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T00:11:53.760 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:53 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:11:53.938 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:53.974 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":24,"num_osds":8,"num_up_osds":8,"osd_up_since":1771287113,"num_in_osds":8,"osd_in_since":1771287090,"num_remapped_pgs":0} 2026-02-17T00:11:53.975 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T00:11:54.132 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:54.324 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:54.324 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":24,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","created":"2026-02-17T00:10:22.510919+0000","modified":"2026-02-17T00:11:53.358500+0000","last_up_change":"2026-02-17T00:11:53.358500+0000","last_in_change":"2026-02-17T00:11:30.598093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":12,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T00:11:49.157405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"62d59ff3-1a72-4da3-afd6-076a2168f4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6800","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6801","nonce":3588585242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6803","nonce":3588585242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6807","nonce":3588585242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6804","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6805","nonce":3588585242}]},"public_addr":"10.20.193.196:6801/3588585242","cluster_addr":"10.20.193.196:6803/3588585242","heartbeat_back_addr":"10.20.193.196:6807/3588585242","heartbeat_front_addr":"10.20.193.196:6805/3588585242","state":["exists","up"]},{"osd":1,"uuid":"557c1534-392c-4db7-9e25-2c6d3968c2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6802","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6803","nonce":1536115416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6804","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6805","nonce":1536115416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6808","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6809","nonce":1536115416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6806","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6807","nonce":1536115416}]},"public_addr":"10.20.193.151:6803/1536115416","cluster_addr":"10.20.193.151:6805/1536115416","heartbeat_back_addr":"10.20.193.151:6809/1536115416","heartbeat_front_addr":"10.20.193.151:6807/1536115416","state":["exists","up"]},{"osd":2,"uuid":"8e6954ce-86f3-4666-83c4-68219a265097","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6810","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6811","nonce":2286637754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6812","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6813","nonce":2286637754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6816","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6817","nonce":2286637754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6814","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6815","nonce":2286637754}]},"public_addr":"10.20.193.151:6811/2286637754","cluster_addr":"10.20.193.151:6813/2286637754","heartbeat_back_addr":"10.20.193.151:6817/2286637754","heartbeat_front_addr":"10.20.193.151:6815/2286637754","state":["exists","up"]},{"osd":3,"uuid":"906a810e-6536-465f-8af2-e44106b0c617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6808","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6809","nonce":2016689849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6811","nonce":2016689849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6814","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6815","nonce":2016689849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6812","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6813","nonce":2016689849}]},"public_addr":"10.20.193.196:6809/2016689849","cluster_addr":"10.20.193.196:6811/2016689849","heartbeat_back_addr":"10.20.193.196:6815/2016689849","heartbeat_front_addr":"10.20.193.196:6813/2016689849","state":["exists","up"]},{"osd":4,"uuid":"7c841aa1-3cf9-4aad-bece-213c8a23b24c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6818","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6819","nonce":2571187101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6820","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6821","nonce":2571187101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6824","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6825","nonce":2571187101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6822","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6823","nonce":2571187101}]},"public_addr":"10.20.193.151:6819/2571187101","cluster_addr":"10.20.193.151:6821/2571187101","heartbeat_back_addr":"10.20.193.151:6825/2571187101","heartbeat_front_addr":"10.20.193.151:6823/2571187101","state":["exists","up"]},{"osd":5,"uuid":"3d576014-c0b3-4aac-992e-bbf99f35171e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6816","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6817","nonce":1615388391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6818","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6819","nonce":1615388391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6822","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6823","nonce":1615388391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6820","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6821","nonce":1615388391}]},"public_addr":"10.20.193.196:6817/1615388391","cluster_addr":"10.20.193.196:6819/1615388391","heartbeat_back_addr":"10.20.193.196:6823/1615388391","heartbeat_front_addr":"10.20.193.196:6821/1615388391","state":["exists","up"]},{"osd":6,"uuid":"b9d95269-f269-48ad-9d34-13627ef11613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6824","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6825","nonce":140611127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6826","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6827","nonce":140611127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6830","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6831","nonce":140611127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6828","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6829","nonce":140611127}]},"public_addr":"10.20.193.196:6825/140611127","cluster_addr":"10.20.193.196:6827/140611127","heartbeat_back_addr":"10.20.193.196:6831/140611127","heartbeat_front_addr":"10.20.193.196:6829/140611127","state":["exists","up"]},{"osd":7,"uuid":"266718b8-2dc7-458b-956f-62a2480f3fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6826","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6827","nonce":3987986570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6828","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6829","nonce":3987986570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6832","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6833","nonce":3987986570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6830","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6831","nonce":3987986570}]},"public_addr":"10.20.193.151:6827/3987986570","cluster_addr":"10.20.193.151:6829/3987986570","heartbeat_back_addr":"10.20.193.151:6833/3987986570","heartbeat_front_addr":"10.20.193.151:6831/3987986570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:43.448995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:43.732549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:46.455248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:45.851172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:48.965831+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:47.945216+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:50.244665+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.151:0/1257808938":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/1145074353":"2026-02-18T00:10:32.304985+0000","10.20.193.151:6800/1265761534":"2026-02-18T00:10:32.304985+0000","10.20.193.151:6801/1265761534":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/3511592694":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6800/646523344":"2026-02-18T00:10:59.121003+0000","10.20.193.151:0/2241950678":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/4287576957":"2026-02-18T00:10:41.740021+0000","10.20.193.151:6801/646523344":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6801/709161439":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/2505924582":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/3063156305":"2026-02-18T00:10:59.121003+0000","10.20.193.151:0/748794223":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/3319366030":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6800/709161439":"2026-02-18T00:10:41.740021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:11:54.361 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-17T00:11:49.157405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T00:11:54.361 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-17T00:11:54.515 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:54.537 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: purged_snaps scrub starts 2026-02-17T00:11:54.537 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: purged_snaps scrub ok 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: OSD bench result of 100059.021481 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.7. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: pgmap v38: 1 pgs: 1 creating+peering; 0 B data, 186 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570] boot 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: osdmap e24: 8 total, 8 up, 8 in 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: mgrmap e19: trial151.mmtaxh(active, since 54s), standbys: trial196.ogdszw 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2434461996' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:54.538 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:54 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1983629987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:11:54.709 INFO:teuthology.orchestra.run.trial151.stdout:pg_num: 1 2026-02-17T00:11:54.749 INFO:tasks.cephadm:Setting up client nodes... 2026-02-17T00:11:54.749 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T00:11:54.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: purged_snaps scrub starts 2026-02-17T00:11:54.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: purged_snaps scrub ok 2026-02-17T00:11:54.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: OSD bench result of 100059.021481 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.7. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T00:11:54.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: pgmap v38: 1 pgs: 1 creating+peering; 0 B data, 186 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:11:54.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:54.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: osd.7 [v2:10.20.193.151:6826/3987986570,v1:10.20.193.151:6827/3987986570] boot 2026-02-17T00:11:54.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: osdmap e24: 8 total, 8 up, 8 in 2026-02-17T00:11:54.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T00:11:54.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: mgrmap e19: trial151.mmtaxh(active, since 54s), standbys: trial196.ogdszw 2026-02-17T00:11:54.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2434461996' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T00:11:54.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:54 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1983629987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:11:54.904 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:55.134 INFO:teuthology.orchestra.run.trial151.stdout:[client.0] 2026-02-17T00:11:55.134 INFO:teuthology.orchestra.run.trial151.stdout: key = AQBLspNpafSTBxAADwlIKkXyC4gSVex6ERB8Pg== 2026-02-17T00:11:55.171 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:11:55.171 DEBUG:teuthology.orchestra.run.trial151:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-17T00:11:55.171 DEBUG:teuthology.orchestra.run.trial151:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T00:11:55.207 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T00:11:55.363 INFO:teuthology.orchestra.run.trial196.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial196/config 2026-02-17T00:11:55.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:55 trial151 ceph-mon[35388]: osdmap e25: 8 total, 8 up, 8 in 2026-02-17T00:11:55.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:55 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/4055005362' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-17T00:11:55.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:55 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2026834357' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T00:11:55.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:55 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2026834357' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T00:11:55.599 INFO:teuthology.orchestra.run.trial196.stdout:[client.1] 2026-02-17T00:11:55.599 INFO:teuthology.orchestra.run.trial196.stdout: key = AQBLspNpzaEdIxAAZImsEzYAgrid2RXQ818uBQ== 2026-02-17T00:11:55.599 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:55 trial196 ceph-mon[42270]: osdmap e25: 8 total, 8 up, 8 in 2026-02-17T00:11:55.600 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:55 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/4055005362' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-17T00:11:55.600 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:55 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2026834357' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T00:11:55.600 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:55 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2026834357' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T00:11:55.647 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:11:55.647 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-17T00:11:55.648 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-17T00:11:55.683 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T00:11:55.684 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-17T00:11:55.685 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-17T00:11:55.839 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:56.059 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:56.096 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":19,"flags":0,"active_gid":14203,"active_name":"trial151.mmtaxh","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6800","nonce":4081499943},{"type":"v1","addr":"10.20.193.151:6801","nonce":4081499943}]},"active_addr":"10.20.193.151:6801/4081499943","active_change":"2026-02-17T00:10:59.121090+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14226,"name":"trial196.ogdszw","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.151:8443/","prometheus":"http://10.20.193.151:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.151:0","nonce":3835900407}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.151:0","nonce":1848016155}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.151:0","nonce":3071705281}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.151:0","nonce":905106854}]}]} 2026-02-17T00:11:56.103 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-17T00:11:56.103 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-17T00:11:56.103 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T00:11:56.259 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:56.451 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:56.452 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":25,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","created":"2026-02-17T00:10:22.510919+0000","modified":"2026-02-17T00:11:54.362778+0000","last_up_change":"2026-02-17T00:11:53.358500+0000","last_in_change":"2026-02-17T00:11:30.598093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":12,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T00:11:49.157405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"62d59ff3-1a72-4da3-afd6-076a2168f4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6800","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6801","nonce":3588585242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6803","nonce":3588585242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6807","nonce":3588585242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6804","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6805","nonce":3588585242}]},"public_addr":"10.20.193.196:6801/3588585242","cluster_addr":"10.20.193.196:6803/3588585242","heartbeat_back_addr":"10.20.193.196:6807/3588585242","heartbeat_front_addr":"10.20.193.196:6805/3588585242","state":["exists","up"]},{"osd":1,"uuid":"557c1534-392c-4db7-9e25-2c6d3968c2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6802","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6803","nonce":1536115416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6804","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6805","nonce":1536115416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6808","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6809","nonce":1536115416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6806","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6807","nonce":1536115416}]},"public_addr":"10.20.193.151:6803/1536115416","cluster_addr":"10.20.193.151:6805/1536115416","heartbeat_back_addr":"10.20.193.151:6809/1536115416","heartbeat_front_addr":"10.20.193.151:6807/1536115416","state":["exists","up"]},{"osd":2,"uuid":"8e6954ce-86f3-4666-83c4-68219a265097","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6810","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6811","nonce":2286637754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6812","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6813","nonce":2286637754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6816","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6817","nonce":2286637754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6814","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6815","nonce":2286637754}]},"public_addr":"10.20.193.151:6811/2286637754","cluster_addr":"10.20.193.151:6813/2286637754","heartbeat_back_addr":"10.20.193.151:6817/2286637754","heartbeat_front_addr":"10.20.193.151:6815/2286637754","state":["exists","up"]},{"osd":3,"uuid":"906a810e-6536-465f-8af2-e44106b0c617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6808","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6809","nonce":2016689849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6811","nonce":2016689849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6814","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6815","nonce":2016689849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6812","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6813","nonce":2016689849}]},"public_addr":"10.20.193.196:6809/2016689849","cluster_addr":"10.20.193.196:6811/2016689849","heartbeat_back_addr":"10.20.193.196:6815/2016689849","heartbeat_front_addr":"10.20.193.196:6813/2016689849","state":["exists","up"]},{"osd":4,"uuid":"7c841aa1-3cf9-4aad-bece-213c8a23b24c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6818","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6819","nonce":2571187101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6820","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6821","nonce":2571187101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6824","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6825","nonce":2571187101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6822","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6823","nonce":2571187101}]},"public_addr":"10.20.193.151:6819/2571187101","cluster_addr":"10.20.193.151:6821/2571187101","heartbeat_back_addr":"10.20.193.151:6825/2571187101","heartbeat_front_addr":"10.20.193.151:6823/2571187101","state":["exists","up"]},{"osd":5,"uuid":"3d576014-c0b3-4aac-992e-bbf99f35171e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6816","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6817","nonce":1615388391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6818","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6819","nonce":1615388391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6822","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6823","nonce":1615388391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6820","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6821","nonce":1615388391}]},"public_addr":"10.20.193.196:6817/1615388391","cluster_addr":"10.20.193.196:6819/1615388391","heartbeat_back_addr":"10.20.193.196:6823/1615388391","heartbeat_front_addr":"10.20.193.196:6821/1615388391","state":["exists","up"]},{"osd":6,"uuid":"b9d95269-f269-48ad-9d34-13627ef11613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6824","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6825","nonce":140611127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6826","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6827","nonce":140611127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6830","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6831","nonce":140611127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6828","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6829","nonce":140611127}]},"public_addr":"10.20.193.196:6825/140611127","cluster_addr":"10.20.193.196:6827/140611127","heartbeat_back_addr":"10.20.193.196:6831/140611127","heartbeat_front_addr":"10.20.193.196:6829/140611127","state":["exists","up"]},{"osd":7,"uuid":"266718b8-2dc7-458b-956f-62a2480f3fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6826","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6827","nonce":3987986570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6828","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6829","nonce":3987986570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6832","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6833","nonce":3987986570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6830","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6831","nonce":3987986570}]},"public_addr":"10.20.193.151:6827/3987986570","cluster_addr":"10.20.193.151:6829/3987986570","heartbeat_back_addr":"10.20.193.151:6833/3987986570","heartbeat_front_addr":"10.20.193.151:6831/3987986570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:43.448995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:43.732549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:46.455248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:45.851172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:48.965831+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:47.945216+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:50.244665+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:51.752501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.151:0/1257808938":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/1145074353":"2026-02-18T00:10:32.304985+0000","10.20.193.151:6800/1265761534":"2026-02-18T00:10:32.304985+0000","10.20.193.151:6801/1265761534":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/3511592694":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6800/646523344":"2026-02-18T00:10:59.121003+0000","10.20.193.151:0/2241950678":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/4287576957":"2026-02-18T00:10:41.740021+0000","10.20.193.151:6801/646523344":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6801/709161439":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/2505924582":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/3063156305":"2026-02-18T00:10:59.121003+0000","10.20.193.151:0/748794223":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/3319366030":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6800/709161439":"2026-02-18T00:10:41.740021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:11:56.489 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-17T00:11:56.490 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T00:11:56.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:56 trial151 ceph-mon[35388]: pgmap v41: 1 pgs: 1 creating+peering; 0 B data, 213 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:11:56.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:56 trial151 ceph-mon[35388]: from='client.? 10.20.193.196:0/1836090861' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T00:11:56.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:56 trial151 ceph-mon[35388]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T00:11:56.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:56 trial151 ceph-mon[35388]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T00:11:56.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:56 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1240245302' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T00:11:56.643 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:56.834 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:11:56.834 INFO:teuthology.orchestra.run.trial151.stdout:{"epoch":25,"fsid":"05b70b75-0b95-11f1-8c5c-d404e6e7d460","created":"2026-02-17T00:10:22.510919+0000","modified":"2026-02-17T00:11:54.362778+0000","last_up_change":"2026-02-17T00:11:53.358500+0000","last_in_change":"2026-02-17T00:11:30.598093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":12,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T00:11:49.157405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"62d59ff3-1a72-4da3-afd6-076a2168f4a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6800","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6801","nonce":3588585242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6803","nonce":3588585242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6807","nonce":3588585242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6804","nonce":3588585242},{"type":"v1","addr":"10.20.193.196:6805","nonce":3588585242}]},"public_addr":"10.20.193.196:6801/3588585242","cluster_addr":"10.20.193.196:6803/3588585242","heartbeat_back_addr":"10.20.193.196:6807/3588585242","heartbeat_front_addr":"10.20.193.196:6805/3588585242","state":["exists","up"]},{"osd":1,"uuid":"557c1534-392c-4db7-9e25-2c6d3968c2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6802","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6803","nonce":1536115416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6804","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6805","nonce":1536115416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6808","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6809","nonce":1536115416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6806","nonce":1536115416},{"type":"v1","addr":"10.20.193.151:6807","nonce":1536115416}]},"public_addr":"10.20.193.151:6803/1536115416","cluster_addr":"10.20.193.151:6805/1536115416","heartbeat_back_addr":"10.20.193.151:6809/1536115416","heartbeat_front_addr":"10.20.193.151:6807/1536115416","state":["exists","up"]},{"osd":2,"uuid":"8e6954ce-86f3-4666-83c4-68219a265097","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6810","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6811","nonce":2286637754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6812","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6813","nonce":2286637754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6816","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6817","nonce":2286637754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6814","nonce":2286637754},{"type":"v1","addr":"10.20.193.151:6815","nonce":2286637754}]},"public_addr":"10.20.193.151:6811/2286637754","cluster_addr":"10.20.193.151:6813/2286637754","heartbeat_back_addr":"10.20.193.151:6817/2286637754","heartbeat_front_addr":"10.20.193.151:6815/2286637754","state":["exists","up"]},{"osd":3,"uuid":"906a810e-6536-465f-8af2-e44106b0c617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6808","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6809","nonce":2016689849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6811","nonce":2016689849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6814","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6815","nonce":2016689849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6812","nonce":2016689849},{"type":"v1","addr":"10.20.193.196:6813","nonce":2016689849}]},"public_addr":"10.20.193.196:6809/2016689849","cluster_addr":"10.20.193.196:6811/2016689849","heartbeat_back_addr":"10.20.193.196:6815/2016689849","heartbeat_front_addr":"10.20.193.196:6813/2016689849","state":["exists","up"]},{"osd":4,"uuid":"7c841aa1-3cf9-4aad-bece-213c8a23b24c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6818","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6819","nonce":2571187101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6820","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6821","nonce":2571187101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6824","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6825","nonce":2571187101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6822","nonce":2571187101},{"type":"v1","addr":"10.20.193.151:6823","nonce":2571187101}]},"public_addr":"10.20.193.151:6819/2571187101","cluster_addr":"10.20.193.151:6821/2571187101","heartbeat_back_addr":"10.20.193.151:6825/2571187101","heartbeat_front_addr":"10.20.193.151:6823/2571187101","state":["exists","up"]},{"osd":5,"uuid":"3d576014-c0b3-4aac-992e-bbf99f35171e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6816","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6817","nonce":1615388391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6818","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6819","nonce":1615388391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6822","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6823","nonce":1615388391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6820","nonce":1615388391},{"type":"v1","addr":"10.20.193.196:6821","nonce":1615388391}]},"public_addr":"10.20.193.196:6817/1615388391","cluster_addr":"10.20.193.196:6819/1615388391","heartbeat_back_addr":"10.20.193.196:6823/1615388391","heartbeat_front_addr":"10.20.193.196:6821/1615388391","state":["exists","up"]},{"osd":6,"uuid":"b9d95269-f269-48ad-9d34-13627ef11613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6824","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6825","nonce":140611127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6826","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6827","nonce":140611127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6830","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6831","nonce":140611127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6828","nonce":140611127},{"type":"v1","addr":"10.20.193.196:6829","nonce":140611127}]},"public_addr":"10.20.193.196:6825/140611127","cluster_addr":"10.20.193.196:6827/140611127","heartbeat_back_addr":"10.20.193.196:6831/140611127","heartbeat_front_addr":"10.20.193.196:6829/140611127","state":["exists","up"]},{"osd":7,"uuid":"266718b8-2dc7-458b-956f-62a2480f3fe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6826","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6827","nonce":3987986570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6828","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6829","nonce":3987986570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6832","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6833","nonce":3987986570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.151:6830","nonce":3987986570},{"type":"v1","addr":"10.20.193.151:6831","nonce":3987986570}]},"public_addr":"10.20.193.151:6827/3987986570","cluster_addr":"10.20.193.151:6829/3987986570","heartbeat_back_addr":"10.20.193.151:6833/3987986570","heartbeat_front_addr":"10.20.193.151:6831/3987986570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:43.448995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:43.732549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:46.455248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:45.851172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:48.965831+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:47.945216+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:50.244665+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:11:51.752501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.151:0/1257808938":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/1145074353":"2026-02-18T00:10:32.304985+0000","10.20.193.151:6800/1265761534":"2026-02-18T00:10:32.304985+0000","10.20.193.151:6801/1265761534":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/3511592694":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6800/646523344":"2026-02-18T00:10:59.121003+0000","10.20.193.151:0/2241950678":"2026-02-18T00:10:32.304985+0000","10.20.193.151:0/4287576957":"2026-02-18T00:10:41.740021+0000","10.20.193.151:6801/646523344":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6801/709161439":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/2505924582":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/3063156305":"2026-02-18T00:10:59.121003+0000","10.20.193.151:0/748794223":"2026-02-18T00:10:41.740021+0000","10.20.193.151:0/3319366030":"2026-02-18T00:10:59.121003+0000","10.20.193.151:6800/709161439":"2026-02-18T00:10:41.740021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:11:56.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:56 trial196 ceph-mon[42270]: pgmap v41: 1 pgs: 1 creating+peering; 0 B data, 213 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:11:56.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:56 trial196 ceph-mon[42270]: from='client.? 10.20.193.196:0/1836090861' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T00:11:56.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:56 trial196 ceph-mon[42270]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T00:11:56.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:56 trial196 ceph-mon[42270]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T00:11:56.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:56 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1240245302' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T00:11:56.870 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-17T00:11:56.871 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-17T00:11:56.871 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-17T00:11:56.871 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-17T00:11:56.871 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-17T00:11:56.871 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-17T00:11:56.872 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-17T00:11:56.872 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-17T00:11:57.231 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.232 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.233 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.235 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.236 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.236 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.236 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.237 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.422 INFO:teuthology.orchestra.run.trial151.stdout:90194313220 2026-02-17T00:11:57.423 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-17T00:11:57.469 INFO:teuthology.orchestra.run.trial151.stdout:103079215108 2026-02-17T00:11:57.469 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-17T00:11:57.504 INFO:teuthology.orchestra.run.trial151.stdout:85899345924 2026-02-17T00:11:57.505 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-17T00:11:57.506 INFO:teuthology.orchestra.run.trial151.stdout:68719476742 2026-02-17T00:11:57.507 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T00:11:57.511 INFO:teuthology.orchestra.run.trial151.stdout:77309411332 2026-02-17T00:11:57.511 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-17T00:11:57.516 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:57 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/712777685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:11:57.517 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:57 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3084857319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:11:57.519 INFO:teuthology.orchestra.run.trial151.stdout:81604378629 2026-02-17T00:11:57.519 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T00:11:57.547 INFO:teuthology.orchestra.run.trial151.stdout:94489280517 2026-02-17T00:11:57.548 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-17T00:11:57.601 INFO:teuthology.orchestra.run.trial151.stdout:68719476741 2026-02-17T00:11:57.602 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T00:11:57.610 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.640 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.722 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.725 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.729 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.769 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.820 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.821 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:57.847 INFO:teuthology.orchestra.run.trial151.stdout:90194313219 2026-02-17T00:11:57.861 INFO:teuthology.orchestra.run.trial151.stdout:103079215107 2026-02-17T00:11:57.862 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:57 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/712777685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:11:57.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:57 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3084857319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T00:11:57.913 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.4 2026-02-17T00:11:57.916 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215108 got 103079215107 for osd.7 2026-02-17T00:11:57.949 INFO:teuthology.orchestra.run.trial151.stdout:85899345923 2026-02-17T00:11:57.953 INFO:teuthology.orchestra.run.trial151.stdout:77309411330 2026-02-17T00:11:57.964 INFO:teuthology.orchestra.run.trial151.stdout:68719476741 2026-02-17T00:11:57.994 INFO:teuthology.orchestra.run.trial151.stdout:81604378628 2026-02-17T00:11:57.997 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345924 got 85899345923 for osd.5 2026-02-17T00:11:57.998 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411330 for osd.3 2026-02-17T00:11:58.018 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.0 2026-02-17T00:11:58.033 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378629 got 81604378628 for osd.2 2026-02-17T00:11:58.040 INFO:teuthology.orchestra.run.trial151.stdout:68719476740 2026-02-17T00:11:58.043 INFO:teuthology.orchestra.run.trial151.stdout:94489280515 2026-02-17T00:11:58.079 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476741 got 68719476740 for osd.1 2026-02-17T00:11:58.083 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280517 got 94489280515 for osd.6 2026-02-17T00:11:58.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 213 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:11:58.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3805683480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T00:11:58.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/676319205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T00:11:58.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/134129791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-17T00:11:58.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/401380646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-17T00:11:58.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2978184317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T00:11:58.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/4164210713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T00:11:58.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3840148324' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T00:11:58.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:58 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/4082768147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-17T00:11:58.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 213 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:11:58.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3805683480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T00:11:58.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/676319205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T00:11:58.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/134129791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-17T00:11:58.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/401380646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-17T00:11:58.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2978184317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T00:11:58.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/4164210713' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T00:11:58.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3840148324' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T00:11:58.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:58 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/4082768147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-17T00:11:58.913 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-17T00:11:58.917 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-17T00:11:58.998 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-17T00:11:58.999 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-17T00:11:59.019 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T00:11:59.034 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T00:11:59.074 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.080 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T00:11:59.084 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-17T00:11:59.152 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.178 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.188 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.258 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.258 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.297 INFO:teuthology.orchestra.run.trial151.stdout:90194313219 2026-02-17T00:11:59.334 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.335 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:11:59.340 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.4 2026-02-17T00:11:59.371 INFO:teuthology.orchestra.run.trial151.stdout:103079215107 2026-02-17T00:11:59.387 INFO:teuthology.orchestra.run.trial151.stdout:77309411332 2026-02-17T00:11:59.389 INFO:teuthology.orchestra.run.trial151.stdout:85899345924 2026-02-17T00:11:59.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215108 got 103079215107 for osd.7 2026-02-17T00:11:59.437 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411332 for osd.3 2026-02-17T00:11:59.437 DEBUG:teuthology.parallel:result is None 2026-02-17T00:11:59.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345924 got 85899345924 for osd.5 2026-02-17T00:11:59.438 DEBUG:teuthology.parallel:result is None 2026-02-17T00:11:59.475 INFO:teuthology.orchestra.run.trial151.stdout:68719476742 2026-02-17T00:11:59.479 INFO:teuthology.orchestra.run.trial151.stdout:81604378629 2026-02-17T00:11:59.519 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378629 got 81604378629 for osd.2 2026-02-17T00:11:59.520 DEBUG:teuthology.parallel:result is None 2026-02-17T00:11:59.520 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.0 2026-02-17T00:11:59.521 DEBUG:teuthology.parallel:result is None 2026-02-17T00:11:59.542 INFO:teuthology.orchestra.run.trial151.stdout:68719476741 2026-02-17T00:11:59.545 INFO:teuthology.orchestra.run.trial151.stdout:94489280517 2026-02-17T00:11:59.582 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476741 got 68719476741 for osd.1 2026-02-17T00:11:59.582 DEBUG:teuthology.parallel:result is None 2026-02-17T00:11:59.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.6 2026-02-17T00:11:59.586 DEBUG:teuthology.parallel:result is None 2026-02-17T00:11:59.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:59 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:59.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:59 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2778435387' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T00:11:59.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:11:59 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1669676923' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T00:11:59.862 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:59 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:11:59.862 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:59 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2778435387' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T00:11:59.862 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:11:59 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1669676923' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T00:12:00.341 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-17T00:12:00.420 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-17T00:12:00.499 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:00.593 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:00.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:00 trial151 ceph-mon[35388]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:00.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:00 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2948729764' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-17T00:12:00.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:00 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2938639376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-17T00:12:00.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:00 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/213671695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T00:12:00.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:00 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/1580269558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T00:12:00.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:00 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/2593341738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T00:12:00.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:00 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/440413030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-17T00:12:00.700 INFO:teuthology.orchestra.run.trial151.stdout:90194313220 2026-02-17T00:12:00.739 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.4 2026-02-17T00:12:00.739 DEBUG:teuthology.parallel:result is None 2026-02-17T00:12:00.796 INFO:teuthology.orchestra.run.trial151.stdout:103079215108 2026-02-17T00:12:00.835 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215108 got 103079215108 for osd.7 2026-02-17T00:12:00.836 DEBUG:teuthology.parallel:result is None 2026-02-17T00:12:00.836 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-17T00:12:00.836 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T00:12:00.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:00 trial196 ceph-mon[42270]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:00.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:00 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2948729764' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-17T00:12:00.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:00 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2938639376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-17T00:12:00.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:00 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/213671695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T00:12:00.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:00 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/1580269558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T00:12:00.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:00 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/2593341738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T00:12:00.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:00 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/440413030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-17T00:12:00.997 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:01.189 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:12:01.190 INFO:teuthology.orchestra.run.trial151.stderr:dumped all 2026-02-17T00:12:01.226 INFO:teuthology.orchestra.run.trial151.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2026-02-17T00:12:01.131023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":5282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5871992832,"kb_used":220372,"kb_used_data":3596,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871772460,"statfs":{"total":6012920659968,"available":6012694999040,"internally_reserved":0,"allocated":3682304,"data_stored":2495768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000282"},"pg_stats":[{"pgid":"1.0","version":"23'212","reported_seq":266,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-17T00:11:55.657786+0000","last_change":"2026-02-17T00:11:52.505032+0000","last_active":"2026-02-17T00:11:55.657786+0000","last_peered":"2026-02-17T00:11:55.657786+0000","last_clean":"2026-02-17T00:11:55.657786+0000","last_became_active":"2026-02-17T00:11:52.504422+0000","last_became_peered":"2026-02-17T00:11:52.504422+0000","last_unstale":"2026-02-17T00:11:55.657786+0000","last_undegraded":"2026-02-17T00:11:55.657786+0000","last_fullsized":"2026-02-17T00:11:55.657786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:11:49.346861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:11:49.346861+0000","last_clean_scrub_stamp":"2026-02-17T00:11:49.346861+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:17:56.679474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":5282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,3],"acting":[6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":5282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971900,"statfs":{"total":751615082496,"available":751587225600,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":28288,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733970816,"statfs":{"total":751615082496,"available":751586115584,"internally_reserved":0,"allocated":831488,"data_stored":680951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971900,"statfs":{"total":751615082496,"available":751587225600,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":20,"seq":85899345925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27208,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971896,"statfs":{"total":751615082496,"available":751587221504,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378630,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":28032,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971072,"statfs":{"total":751615082496,"available":751586377728,"internally_reserved":0,"allocated":831488,"data_stored":680951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":18,"seq":77309411332,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":28032,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971072,"statfs":{"total":751615082496,"available":751586377728,"internally_reserved":0,"allocated":831488,"data_stored":680951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27200,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971904,"statfs":{"total":751615082496,"available":751587229696,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971900,"statfs":{"total":751615082496,"available":751587225600,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:12:01.228 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T00:12:01.381 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:01.574 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:12:01.575 INFO:teuthology.orchestra.run.trial151.stderr:dumped all 2026-02-17T00:12:01.604 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:01 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/526863002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T00:12:01.604 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:01 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/192734618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T00:12:01.627 INFO:teuthology.orchestra.run.trial151.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2026-02-17T00:12:01.131023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":5282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5871992832,"kb_used":220372,"kb_used_data":3596,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871772460,"statfs":{"total":6012920659968,"available":6012694999040,"internally_reserved":0,"allocated":3682304,"data_stored":2495768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000282"},"pg_stats":[{"pgid":"1.0","version":"23'212","reported_seq":266,"reported_epoch":25,"state":"active+clean","last_fresh":"2026-02-17T00:11:55.657786+0000","last_change":"2026-02-17T00:11:52.505032+0000","last_active":"2026-02-17T00:11:55.657786+0000","last_peered":"2026-02-17T00:11:55.657786+0000","last_clean":"2026-02-17T00:11:55.657786+0000","last_became_active":"2026-02-17T00:11:52.504422+0000","last_became_peered":"2026-02-17T00:11:52.504422+0000","last_unstale":"2026-02-17T00:11:55.657786+0000","last_undegraded":"2026-02-17T00:11:55.657786+0000","last_fullsized":"2026-02-17T00:11:55.657786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:11:49.346861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:11:49.346861+0000","last_clean_scrub_stamp":"2026-02-17T00:11:49.346861+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:17:56.679474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":5282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,3],"acting":[6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":5282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971900,"statfs":{"total":751615082496,"available":751587225600,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":28288,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733970816,"statfs":{"total":751615082496,"available":751586115584,"internally_reserved":0,"allocated":831488,"data_stored":680951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971900,"statfs":{"total":751615082496,"available":751587225600,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":20,"seq":85899345925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27208,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971896,"statfs":{"total":751615082496,"available":751587221504,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378630,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":28032,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971072,"statfs":{"total":751615082496,"available":751586377728,"internally_reserved":0,"allocated":831488,"data_stored":680951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":18,"seq":77309411332,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":28032,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971072,"statfs":{"total":751615082496,"available":751586377728,"internally_reserved":0,"allocated":831488,"data_stored":680951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27200,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971904,"statfs":{"total":751615082496,"available":751587229696,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971900,"statfs":{"total":751615082496,"available":751587225600,"internally_reserved":0,"allocated":237568,"data_stored":90583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:12:01.628 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-17T00:12:01.628 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T00:12:01.629 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-17T00:12:01.629 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph health --format=json 2026-02-17T00:12:01.782 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:01.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:01 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/526863002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T00:12:01.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:01 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/192734618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T00:12:01.993 INFO:teuthology.orchestra.run.trial151.stdout: 2026-02-17T00:12:01.993 INFO:teuthology.orchestra.run.trial151.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T00:12:02.030 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-17T00:12:02.030 INFO:tasks.cephadm:Setup complete, yielding 2026-02-17T00:12:02.030 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-17T00:12:02.041 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial151.front.sepia.ceph.com 2026-02-17T00:12:02.042 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-17T00:12:02.196 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:02.395 INFO:teuthology.orchestra.run.trial151.stdout:Backend: cephadm 2026-02-17T00:12:02.395 INFO:teuthology.orchestra.run.trial151.stdout:Available: Yes 2026-02-17T00:12:02.395 INFO:teuthology.orchestra.run.trial151.stdout:Paused: No 2026-02-17T00:12:02.434 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-17T00:12:02.590 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:02.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:02 trial151 ceph-mon[35388]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:02.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:02 trial151 ceph-mon[35388]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:12:02.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:02 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3813473853' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T00:12:02.788 INFO:teuthology.orchestra.run.trial151.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:alertmanager.trial151 trial151 *:9093,9094 running (48s) 15s ago 72s 33.6M - 0.25.0 c8568f914cd2 ed16da3d3a4a 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:ceph-exporter.trial151 trial151 *:9926 running (75s) 15s ago 75s 8154k - 19.2.3-680-g05b55d19 dcf18b7f874c 711723eca866 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:ceph-exporter.trial196 trial196 *:9926 running (59s) 15s ago 59s 6559k - 19.2.3-680-g05b55d19 dcf18b7f874c dd1f5d5d892e 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:crash.trial151 trial151 running (74s) 15s ago 74s 7629k - 19.2.3-680-g05b55d19 dcf18b7f874c df77476469f0 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:crash.trial196 trial196 running (58s) 15s ago 58s 7629k - 19.2.3-680-g05b55d19 dcf18b7f874c 445ea5a79759 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:grafana.trial151 trial151 *:3000 running (47s) 15s ago 69s 80.0M - 10.4.0 c8b91775d855 3d9cdf96ae81 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:mgr.trial151.mmtaxh trial151 *:9283,8765,8443 running (98s) 15s ago 98s 538M - 19.2.3-680-g05b55d19 dcf18b7f874c 4826aa88e302 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:mgr.trial196.ogdszw trial196 *:8443,9283,8765 running (56s) 15s ago 56s 483M - 19.2.3-680-g05b55d19 dcf18b7f874c 54fdf0f10cfe 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:mon.trial151 trial151 running (99s) 15s ago 100s 47.5M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c 590184a2302f 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:mon.trial196 trial196 running (56s) 15s ago 56s 41.5M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c 35a64acf96e5 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:node-exporter.trial151 trial151 *:9100 running (73s) 15s ago 73s 13.8M - 1.7.0 72c9c2088986 619b29e35094 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:node-exporter.trial196 trial196 *:9100 running (57s) 15s ago 57s 12.1M - 1.7.0 72c9c2088986 51fc5b52a82d 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.0 trial196 running (25s) 15s ago 25s 39.1M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 995a5cff6366 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.1 trial151 running (25s) 15s ago 25s 29.9M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 667378c851f0 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.2 trial151 running (22s) 15s ago 22s 28.2M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c e4326f715e15 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.3 trial196 running (23s) 15s ago 23s 28.8M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c fceeb56e8a79 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.4 trial151 running (20s) 15s ago 20s 17.0M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 1e275a83bc2b 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.5 trial196 running (21s) 15s ago 21s 44.9M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 8760ad51d865 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.6 trial196 running (18s) 15s ago 18s 14.6M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 709ec27e29a0 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:osd.7 trial151 running (17s) 15s ago 17s 15.4M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 94bc880ac689 2026-02-17T00:12:02.789 INFO:teuthology.orchestra.run.trial151.stdout:prometheus.trial151 trial151 *:9095 running (47s) 15s ago 67s 36.6M - 2.51.0 1d3b7f56885b c770bc345aab 2026-02-17T00:12:02.827 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-17T00:12:02.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:02 trial196 ceph-mon[42270]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:02.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:02 trial196 ceph-mon[42270]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:12:02.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:02 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3813473853' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T00:12:02.982 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:03.188 INFO:teuthology.orchestra.run.trial151.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-17T00:12:03.189 INFO:teuthology.orchestra.run.trial151.stdout:alertmanager ?:9093,9094 1/1 15s ago 85s count:1 2026-02-17T00:12:03.189 INFO:teuthology.orchestra.run.trial151.stdout:ceph-exporter ?:9926 2/2 15s ago 86s * 2026-02-17T00:12:03.189 INFO:teuthology.orchestra.run.trial151.stdout:crash 2/2 15s ago 86s * 2026-02-17T00:12:03.189 INFO:teuthology.orchestra.run.trial151.stdout:grafana ?:3000 1/1 15s ago 85s count:1 2026-02-17T00:12:03.189 INFO:teuthology.orchestra.run.trial151.stdout:mgr 2/2 15s ago 86s count:2 2026-02-17T00:12:03.189 INFO:teuthology.orchestra.run.trial151.stdout:mon 2/2 15s ago 72s trial151:10.20.193.151=trial151;trial196:10.20.193.196=trial196;count:2 2026-02-17T00:12:03.189 INFO:teuthology.orchestra.run.trial151.stdout:node-exporter ?:9100 2/2 15s ago 85s * 2026-02-17T00:12:03.190 INFO:teuthology.orchestra.run.trial151.stdout:osd.all-available-devices 8 15s ago 47s * 2026-02-17T00:12:03.190 INFO:teuthology.orchestra.run.trial151.stdout:prometheus ?:9095 1/1 15s ago 86s count:1 2026-02-17T00:12:03.224 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-17T00:12:03.378 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:03.582 INFO:teuthology.orchestra.run.trial151.stdout:HOST ADDR LABELS STATUS 2026-02-17T00:12:03.582 INFO:teuthology.orchestra.run.trial151.stdout:trial151 10.20.193.151 2026-02-17T00:12:03.583 INFO:teuthology.orchestra.run.trial151.stdout:trial196 10.20.193.196 2026-02-17T00:12:03.583 INFO:teuthology.orchestra.run.trial151.stdout:2 hosts in cluster 2026-02-17T00:12:03.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:03 trial196 ceph-mon[42270]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:12:03.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:03 trial196 ceph-mon[42270]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:03.620 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-17T00:12:03.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:03 trial151 ceph-mon[35388]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T00:12:03.643 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:03 trial151 ceph-mon[35388]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:03.775 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:03.977 INFO:teuthology.orchestra.run.trial151.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-17T00:12:03.977 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00266 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-17T00:12:03.977 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B002D5 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-17T00:12:03.977 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme3n1 ssd Linux_68c46a24a7e86f5e226e 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:03.977 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme4n1 ssd Linux_528323697d53fff9e321 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:03.977 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme5n1 ssd Linux_ea9f59d8a66cac27b3e5 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:03.978 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme6n1 ssd Linux_46d5e66c499017cd469d 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:03.978 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47E25 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-17T00:12:03.978 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47DB4 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-17T00:12:03.978 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme3n1 ssd Linux_4ddfda260f8425d85933 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:03.978 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme4n1 ssd Linux_6d0b3fa2fbc4e2ac8d12 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:03.978 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme5n1 ssd Linux_e00fb1400837f5be28fa 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:03.978 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme6n1 ssd Linux_ef5249703d03f51e94d3 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.014 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- bash -c 'ceph orch ls | grep '"'"'^osd.all-available-devices '"'"'' 2026-02-17T00:12:04.207 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:04.417 INFO:teuthology.orchestra.run.trial151.stdout:osd.all-available-devices 8 17s ago 48s * 2026-02-17T00:12:04.446 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-17T00:12:04.463 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial151.front.sepia.ceph.com 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- bash -c 'set -e 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> set -x 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> ceph orch ps 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> ceph orch device ls 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> DEVID=$(ceph device ls | grep osd.1 | awk '"'"'{print $1}'"'"') 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> HOST=$(ceph orch device ls | grep $DEVID | awk '"'"'{print $1}'"'"') 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> DEV=$(ceph orch device ls | grep $DEVID | awk '"'"'{print $2}'"'"') 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> echo "host $HOST, dev $DEV, devid $DEVID" 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> ceph orch osd rm 1 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> while ceph orch osd rm status | grep ^1 ; do sleep 5 ; done 2026-02-17T00:12:04.464 DEBUG:teuthology.orchestra.run.trial151:> ceph orch device zap $HOST $DEV --force 2026-02-17T00:12:04.465 DEBUG:teuthology.orchestra.run.trial151:> ceph orch daemon add osd $HOST:$DEV 2026-02-17T00:12:04.465 DEBUG:teuthology.orchestra.run.trial151:> while ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done 2026-02-17T00:12:04.465 DEBUG:teuthology.orchestra.run.trial151:> ' 2026-02-17T00:12:04.487 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:04 trial151 ceph-mon[35388]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:04.487 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:04 trial151 ceph-mon[35388]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:04.487 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:04 trial151 ceph-mon[35388]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:04.618 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:04.683 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph orch ps 2026-02-17T00:12:04.821 INFO:teuthology.orchestra.run.trial151.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:alertmanager.trial151 trial151 *:9093,9094 running (50s) 17s ago 74s 33.6M - 0.25.0 c8568f914cd2 ed16da3d3a4a 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:ceph-exporter.trial151 trial151 *:9926 running (77s) 17s ago 77s 8154k - 19.2.3-680-g05b55d19 dcf18b7f874c 711723eca866 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:ceph-exporter.trial196 trial196 *:9926 running (61s) 17s ago 61s 6559k - 19.2.3-680-g05b55d19 dcf18b7f874c dd1f5d5d892e 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:crash.trial151 trial151 running (76s) 17s ago 76s 7629k - 19.2.3-680-g05b55d19 dcf18b7f874c df77476469f0 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:crash.trial196 trial196 running (60s) 17s ago 60s 7629k - 19.2.3-680-g05b55d19 dcf18b7f874c 445ea5a79759 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:grafana.trial151 trial151 *:3000 running (49s) 17s ago 71s 80.0M - 10.4.0 c8b91775d855 3d9cdf96ae81 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:mgr.trial151.mmtaxh trial151 *:9283,8765,8443 running (100s) 17s ago 100s 538M - 19.2.3-680-g05b55d19 dcf18b7f874c 4826aa88e302 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:mgr.trial196.ogdszw trial196 *:8443,9283,8765 running (58s) 17s ago 58s 483M - 19.2.3-680-g05b55d19 dcf18b7f874c 54fdf0f10cfe 2026-02-17T00:12:04.822 INFO:teuthology.orchestra.run.trial151.stdout:mon.trial151 trial151 running (101s) 17s ago 102s 47.5M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c 590184a2302f 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:mon.trial196 trial196 running (58s) 17s ago 58s 41.5M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c 35a64acf96e5 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:node-exporter.trial151 trial151 *:9100 running (75s) 17s ago 75s 13.8M - 1.7.0 72c9c2088986 619b29e35094 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:node-exporter.trial196 trial196 *:9100 running (59s) 17s ago 59s 12.1M - 1.7.0 72c9c2088986 51fc5b52a82d 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.0 trial196 running (27s) 17s ago 27s 39.1M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 995a5cff6366 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.1 trial151 running (27s) 17s ago 27s 29.9M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 667378c851f0 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.2 trial151 running (24s) 17s ago 24s 28.2M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c e4326f715e15 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.3 trial196 running (25s) 17s ago 25s 28.8M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c fceeb56e8a79 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.4 trial151 running (22s) 17s ago 22s 17.0M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 1e275a83bc2b 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.5 trial196 running (23s) 17s ago 23s 44.9M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 8760ad51d865 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.6 trial196 running (20s) 17s ago 20s 14.6M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 709ec27e29a0 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:osd.7 trial151 running (19s) 17s ago 19s 15.4M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 94bc880ac689 2026-02-17T00:12:04.823 INFO:teuthology.orchestra.run.trial151.stdout:prometheus.trial151 trial151 *:9095 running (49s) 17s ago 69s 36.6M - 2.51.0 1d3b7f56885b c770bc345aab 2026-02-17T00:12:04.828 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph orch device ls 2026-02-17T00:12:04.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:04 trial196 ceph-mon[42270]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:04.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:04 trial196 ceph-mon[42270]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:04.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:04 trial196 ceph-mon[42270]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:04.965 INFO:teuthology.orchestra.run.trial151.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-17T00:12:04.965 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00266 1788G No 16s ago Has a FileSystem, LVM detected 2026-02-17T00:12:04.965 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B002D5 1788G No 16s ago Has a FileSystem, LVM detected 2026-02-17T00:12:04.965 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme3n1 ssd Linux_68c46a24a7e86f5e226e 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme4n1 ssd Linux_528323697d53fff9e321 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme5n1 ssd Linux_ea9f59d8a66cac27b3e5 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial151 /dev/nvme6n1 ssd Linux_46d5e66c499017cd469d 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47E25 1788G No 16s ago Has a FileSystem, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47DB4 1788G No 16s ago Has a FileSystem, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme3n1 ssd Linux_4ddfda260f8425d85933 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme4n1 ssd Linux_6d0b3fa2fbc4e2ac8d12 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme5n1 ssd Linux_e00fb1400837f5be28fa 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.966 INFO:teuthology.orchestra.run.trial151.stdout:trial196 /dev/nvme6n1 ssd Linux_ef5249703d03f51e94d3 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-17T00:12:04.973 INFO:teuthology.orchestra.run.trial151.stderr:++ ceph device ls 2026-02-17T00:12:04.973 INFO:teuthology.orchestra.run.trial151.stderr:++ grep osd.1 2026-02-17T00:12:04.974 INFO:teuthology.orchestra.run.trial151.stderr:++ awk '{print $1}' 2026-02-17T00:12:05.111 INFO:teuthology.orchestra.run.trial151.stderr:+ DEVID=Linux_68c46a24a7e86f5e226e 2026-02-17T00:12:05.111 INFO:teuthology.orchestra.run.trial151.stderr:++ ceph orch device ls 2026-02-17T00:12:05.111 INFO:teuthology.orchestra.run.trial151.stderr:++ grep Linux_68c46a24a7e86f5e226e 2026-02-17T00:12:05.111 INFO:teuthology.orchestra.run.trial151.stderr:++ awk '{print $1}' 2026-02-17T00:12:05.255 INFO:teuthology.orchestra.run.trial151.stderr:+ HOST=trial151 2026-02-17T00:12:05.255 INFO:teuthology.orchestra.run.trial151.stderr:++ ceph orch device ls 2026-02-17T00:12:05.255 INFO:teuthology.orchestra.run.trial151.stderr:++ grep Linux_68c46a24a7e86f5e226e 2026-02-17T00:12:05.255 INFO:teuthology.orchestra.run.trial151.stderr:++ awk '{print $2}' 2026-02-17T00:12:05.396 INFO:teuthology.orchestra.run.trial151.stdout:host trial151, dev /dev/nvme3n1, devid Linux_68c46a24a7e86f5e226e 2026-02-17T00:12:05.396 INFO:teuthology.orchestra.run.trial151.stderr:+ DEV=/dev/nvme3n1 2026-02-17T00:12:05.396 INFO:teuthology.orchestra.run.trial151.stderr:+ echo 'host trial151, dev /dev/nvme3n1, devid Linux_68c46a24a7e86f5e226e' 2026-02-17T00:12:05.397 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph orch osd rm 1 2026-02-17T00:12:05.535 INFO:teuthology.orchestra.run.trial151.stdout:Scheduled OSD(s) for removal. 2026-02-17T00:12:05.535 INFO:teuthology.orchestra.run.trial151.stdout:VG/LV for the OSDs won't be zapped (--zap wasn't passed). 2026-02-17T00:12:05.535 INFO:teuthology.orchestra.run.trial151.stdout:Run the `ceph-volume lvm zap` command with `--destroy` against the VG/LV if you want them to be destroyed. 2026-02-17T00:12:05.543 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph orch osd rm status 2026-02-17T00:12:05.543 INFO:teuthology.orchestra.run.trial151.stderr:+ grep '^1' 2026-02-17T00:12:05.692 INFO:teuthology.orchestra.run.trial151.stdout:1 trial151 started 0 False False False 2026-02-17T00:12:05.693 INFO:teuthology.orchestra.run.trial151.stderr:+ sleep 5 2026-02-17T00:12:05.693 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:05 trial151 ceph-mon[35388]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:05.694 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:05 trial151 ceph-mon[35388]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:05.694 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:05 trial151 ceph-mon[35388]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:05.776 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:05 trial196 ceph-mon[42270]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:05.776 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:05 trial196 ceph-mon[42270]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:05.776 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:05 trial196 ceph-mon[42270]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:06.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-17T00:12:06.599 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:06.600 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:06.600 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:06.600 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:06.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:06.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:06.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-17T00:12:06.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:06.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:06.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:06.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:06 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:07.098 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:06 trial151 ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151[35384]: 2026-02-17T00:12:06.690+0000 7f47a99ad640 -1 mon.trial151@0(leader).osd e25 definitely_dead 0 2026-02-17T00:12:07.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["1"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:07.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: osd.1 crush weight is 0.68359375 2026-02-17T00:12:07.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch osd rm status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:07.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:07.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:07.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:07.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:07.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:07.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:07.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:07.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["1"]}]: dispatch 2026-02-17T00:12:07.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:07 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd down", "ids": ["1"]}]: dispatch 2026-02-17T00:12:07.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["1"], "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:07.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: osd.1 crush weight is 0.68359375 2026-02-17T00:12:07.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch osd rm status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:07.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:07.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:07.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:07.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:07.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:07.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:07.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:07.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["1"]}]: dispatch 2026-02-17T00:12:07.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:07 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd down", "ids": ["1"]}]: dispatch 2026-02-17T00:12:08.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:08.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:08.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["1"]}]: dispatch 2026-02-17T00:12:08.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:08.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: Health check failed: 1 osds down (OSD_DOWN) 2026-02-17T00:12:08.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd down", "ids": ["1"]}]': finished 2026-02-17T00:12:08.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: osdmap e26: 8 total, 7 up, 8 in 2026-02-17T00:12:08.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: osd.1 now down 2026-02-17T00:12:08.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:08 trial196 ceph-mon[42270]: Removing daemon osd.1 from trial151 -- ports [] 2026-02-17T00:12:08.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:08.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-17T00:12:08.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["1"]}]: dispatch 2026-02-17T00:12:08.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T00:12:08.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: Health check failed: 1 osds down (OSD_DOWN) 2026-02-17T00:12:08.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd down", "ids": ["1"]}]': finished 2026-02-17T00:12:08.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: osdmap e26: 8 total, 7 up, 8 in 2026-02-17T00:12:08.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: osd.1 now down 2026-02-17T00:12:08.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:08 trial151 ceph-mon[35388]: Removing daemon osd.1 from trial151 -- ports [] 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth rm", "entity": "osd.1"}]: dispatch 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "auth rm", "entity": "osd.1"}]': finished 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd purge-actual", "id": 1, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: Health check cleared: OSD_DOWN (was: 1 osds down) 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: Cluster is now healthy 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd purge-actual", "id": 1, "yes_i_really_mean_it": true}]': finished 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: osdmap e27: 7 total, 7 up, 7 in 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:09.553 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:09.554 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:09.554 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:09 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:09.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth rm", "entity": "osd.1"}]: dispatch 2026-02-17T00:12:09.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "auth rm", "entity": "osd.1"}]': finished 2026-02-17T00:12:09.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd purge-actual", "id": 1, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T00:12:09.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: Health check cleared: OSD_DOWN (was: 1 osds down) 2026-02-17T00:12:09.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: Cluster is now healthy 2026-02-17T00:12:09.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd='[{"prefix": "osd purge-actual", "id": 1, "yes_i_really_mean_it": true}]': finished 2026-02-17T00:12:09.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: osdmap e27: 7 total, 7 up, 7 in 2026-02-17T00:12:09.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:09.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:09.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:09.864 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:09 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:10.694 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph orch osd rm status 2026-02-17T00:12:10.694 INFO:teuthology.orchestra.run.trial151.stderr:+ grep '^1' 2026-02-17T00:12:10.841 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph orch device zap trial151 /dev/nvme3n1 --force 2026-02-17T00:12:10.842 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:10 trial151 ceph-mon[35388]: Removing key for osd.1 2026-02-17T00:12:10.842 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:10 trial151 ceph-mon[35388]: Successfully removed osd.1 on trial151 2026-02-17T00:12:10.842 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:10 trial151 ceph-mon[35388]: Successfully purged osd.1 on trial151 2026-02-17T00:12:10.842 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:10 trial151 ceph-mon[35388]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:10.842 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:10 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:10.842 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:10 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:10.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:10 trial196 ceph-mon[42270]: Removing key for osd.1 2026-02-17T00:12:10.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:10 trial196 ceph-mon[42270]: Successfully removed osd.1 on trial151 2026-02-17T00:12:10.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:10 trial196 ceph-mon[42270]: Successfully purged osd.1 on trial151 2026-02-17T00:12:10.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:10 trial196 ceph-mon[42270]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:10.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:10 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:10.863 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:10 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:11.943 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch osd rm status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch device zap", "hostname": "trial151", "path": "/dev/nvme3n1", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: Zap device trial151:/dev/nvme3n1 2026-02-17T00:12:11.944 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:11.945 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:11.945 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:11 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch osd rm status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch device zap", "hostname": "trial151", "path": "/dev/nvme3n1", "force": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:12.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: Zap device trial151:/dev/nvme3n1 2026-02-17T00:12:12.115 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:12.115 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.115 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:11 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.500 INFO:teuthology.orchestra.run.trial151.stdout:zap successful for /dev/nvme3n1 on trial151 2026-02-17T00:12:12.509 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph orch daemon add osd trial151:/dev/nvme3n1 2026-02-17T00:12:12.990 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.990 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.990 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:12.990 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:12.990 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:12.991 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:12.991 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: zap successful for /dev/nvme3n1 on trial151 2026-02-17T00:12:12.991 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:12.991 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:12.991 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:12:12.991 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:12 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:13.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:13.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:13.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:13.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:13.113 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:13.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:13.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: zap successful for /dev/nvme3n1 on trial151 2026-02-17T00:12:13.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:13.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:13.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T00:12:13.114 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:12 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:14.165 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial151:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:14.165 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.165 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.165 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:14.165 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.165 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.166 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/923377138' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2acd980a-05a6-472d-b367-d3426f8c94ea"}]: dispatch 2026-02-17T00:12:14.166 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/923377138' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2acd980a-05a6-472d-b367-d3426f8c94ea"}]': finished 2026-02-17T00:12:14.166 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: osdmap e28: 8 total, 7 up, 8 in 2026-02-17T00:12:14.166 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:12:14.166 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.166 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.166 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:14 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/3016941103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial151:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/923377138' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2acd980a-05a6-472d-b367-d3426f8c94ea"}]: dispatch 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/923377138' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2acd980a-05a6-472d-b367-d3426f8c94ea"}]': finished 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: osdmap e28: 8 total, 7 up, 8 in 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:14.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:14 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/3016941103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T00:12:15.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:15 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:12:15.597 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:15 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T00:12:16.362 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:16 trial196 ceph-mon[42270]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:16.598 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:16 trial151 ceph-mon[35388]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:18.460 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:18 trial151 ceph-mon[35388]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:18.461 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:18 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:18.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:18 trial196 ceph-mon[42270]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:18.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:18.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:18.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:18.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:18.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:18.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:18 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:19.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:19 trial151 ceph-mon[35388]: Detected new or changed devices on trial151 2026-02-17T00:12:19.348 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:19 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T00:12:19.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:19 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:19.349 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:19 trial151 ceph-mon[35388]: Deploying daemon osd.1 on trial151 2026-02-17T00:12:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:19 trial196 ceph-mon[42270]: Detected new or changed devices on trial151 2026-02-17T00:12:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:19 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T00:12:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:19 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:19.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:19 trial196 ceph-mon[42270]: Deploying daemon osd.1 on trial151 2026-02-17T00:12:20.522 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:20 trial151 ceph-mon[35388]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:20.612 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:20 trial196 ceph-mon[42270]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:21.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:21 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:21.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:21 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:21.363 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:21 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:21.434 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:21 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:21.434 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:21 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:21.434 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:21 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.075 INFO:teuthology.orchestra.run.trial151.stdout:Created osd(s) 1 on host 'trial151' 2026-02-17T00:12:22.083 INFO:teuthology.orchestra.run.trial151.stderr:+ ceph osd dump 2026-02-17T00:12:22.083 INFO:teuthology.orchestra.run.trial151.stderr:+ grep osd.1 2026-02-17T00:12:22.083 INFO:teuthology.orchestra.run.trial151.stderr:+ grep up 2026-02-17T00:12:22.225 INFO:teuthology.orchestra.run.trial151.stdout:osd.1 down in weight 1 up_from 0 up_thru 0 down_at 0 last_clean_interval [0,0) exists,new 2acd980a-05a6-472d-b367-d3426f8c94ea 2026-02-17T00:12:22.259 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-17T00:12:22.274 INFO:tasks.cephadm:Teardown begin 2026-02-17T00:12:22.274 DEBUG:teuthology.orchestra.run.trial151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:12:22.327 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:12:22.353 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-17T00:12:22.353 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-17T00:12:22.528 INFO:teuthology.orchestra.run.trial151.stderr:Inferring config /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/mon.trial151/config 2026-02-17T00:12:22.547 INFO:teuthology.orchestra.run.trial151.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-17T00:12:22.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:22.565 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.566 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.567 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-mon[35388]: from='client.? 10.20.193.151:0/217118230' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2026-02-17T00:12:22.567 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-17T00:12:22.568 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-17T00:12:22.568 DEBUG:teuthology.orchestra.run.trial151:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-17T00:12:22.586 DEBUG:teuthology.orchestra.run.trial196:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-17T00:12:22.603 INFO:tasks.cephadm:Stopping all daemons... 2026-02-17T00:12:22.603 INFO:tasks.cephadm.mon.trial151:Stopping mon.trial151... 2026-02-17T00:12:22.604 DEBUG:teuthology.orchestra.run.trial151:> sudo systemctl stop ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151 2026-02-17T00:12:22.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T00:12:22.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T00:12:22.613 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T00:12:22.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T00:12:22.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T00:12:22.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='mgr.14203 10.20.193.151:0/1781985935' entity='mgr.trial151.mmtaxh' 2026-02-17T00:12:22.614 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 ceph-mon[42270]: from='client.? 10.20.193.151:0/217118230' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2026-02-17T00:12:22.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 systemd[1]: Stopping Ceph mon.trial151 for 05b70b75-0b95-11f1-8c5c-d404e6e7d460... 2026-02-17T00:12:22.848 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151[35384]: 2026-02-17T00:12:22.729+0000 7f47af1b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial151 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:12:22.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151[35384]: 2026-02-17T00:12:22.729+0000 7f47af1b8640 -1 mon.trial151@0(leader) e2 *** Got Signal Terminated *** 2026-02-17T00:12:22.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 podman[92697]: 2026-02-17 00:12:22.781157899 +0000 UTC m=+0.066698534 container died 590184a2302f64b18b96550c3f1f031a177753010bbf966ecbd0b7933459a5fc (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260202, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.vendor=CentOS) 2026-02-17T00:12:22.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 podman[92697]: 2026-02-17 00:12:22.791134924 +0000 UTC m=+0.076675559 container remove 590184a2302f64b18b96550c3f1f031a177753010bbf966ecbd0b7933459a5fc (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, OSD_FLAVOR=default, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-17T00:12:22.849 INFO:journalctl@ceph.mon.trial151.trial151.stdout:Feb 17 00:12:22 trial151 bash[92697]: ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial151 2026-02-17T00:12:22.873 DEBUG:teuthology.orchestra.run.trial151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial151.service' 2026-02-17T00:12:22.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T00:12:22.916 INFO:tasks.cephadm.mon.trial151:Stopped mon.trial151 2026-02-17T00:12:22.916 INFO:tasks.cephadm.mon.trial196:Stopping mon.trial196... 2026-02-17T00:12:22.916 DEBUG:teuthology.orchestra.run.trial196:> sudo systemctl stop ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial196 2026-02-17T00:12:23.200 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:22 trial196 systemd[1]: Stopping Ceph mon.trial196 for 05b70b75-0b95-11f1-8c5c-d404e6e7d460... 2026-02-17T00:12:23.200 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:23 trial196 ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial196[42266]: 2026-02-17T00:12:23.010+0000 7f01a8ef8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial196 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T00:12:23.200 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:23 trial196 ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial196[42266]: 2026-02-17T00:12:23.010+0000 7f01a8ef8640 -1 mon.trial196@1(peon) e2 *** Got Signal Terminated *** 2026-02-17T00:12:23.200 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:23 trial196 podman[61214]: 2026-02-17 00:12:23.132310138 +0000 UTC m=+0.134697051 container died 35a64acf96e5416cc18a8560ea7ede833a30b107ba59f23fc7d2cd21ad2b451f (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial196, org.label-schema.build-date=20260202, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-17T00:12:23.200 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:23 trial196 podman[61214]: 2026-02-17 00:12:23.14103597 +0000 UTC m=+0.143422873 container remove 35a64acf96e5416cc18a8560ea7ede833a30b107ba59f23fc7d2cd21ad2b451f (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial196, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260202, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T00:12:23.200 INFO:journalctl@ceph.mon.trial196.trial196.stdout:Feb 17 00:12:23 trial196 bash[61214]: ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460-mon-trial196 2026-02-17T00:12:23.214 DEBUG:teuthology.orchestra.run.trial196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-05b70b75-0b95-11f1-8c5c-d404e6e7d460@mon.trial196.service' 2026-02-17T00:12:23.252 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T00:12:23.253 INFO:tasks.cephadm.mon.trial196:Stopped mon.trial196 2026-02-17T00:12:23.253 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 --force --keep-logs 2026-02-17T00:12:23.364 INFO:teuthology.orchestra.run.trial151.stdout:Deleting cluster with fsid: 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:12:44.769 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 --force --keep-logs 2026-02-17T00:12:44.886 INFO:teuthology.orchestra.run.trial196.stdout:Deleting cluster with fsid: 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:13:10.709 DEBUG:teuthology.orchestra.run.trial151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:13:10.737 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T00:13:10.764 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-17T00:13:10.767 DEBUG:teuthology.misc:Transferring archived files from trial151:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337/remote/trial151/crash 2026-02-17T00:13:10.768 DEBUG:teuthology.orchestra.run.trial151:> sudo tar c -f - -C /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/crash -- . 2026-02-17T00:13:10.802 INFO:teuthology.orchestra.run.trial151.stderr:tar: /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-17T00:13:10.802 INFO:teuthology.orchestra.run.trial151.stderr:tar: Error is not recoverable: exiting now 2026-02-17T00:13:10.804 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337/remote/trial196/crash 2026-02-17T00:13:10.805 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/crash -- . 2026-02-17T00:13:10.829 INFO:teuthology.orchestra.run.trial196.stderr:tar: /var/lib/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-17T00:13:10.830 INFO:teuthology.orchestra.run.trial196.stderr:tar: Error is not recoverable: exiting now 2026-02-17T00:13:10.831 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-17T00:13:10.831 DEBUG:teuthology.orchestra.run.trial151:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v OSD_DOWN | egrep -v CEPHADM_FAILED_DAEMON | egrep -v 'but it is still running' | egrep -v PG_DEGRADED | head -n 1 2026-02-17T00:13:10.871 INFO:tasks.cephadm:Compressing logs... 2026-02-17T00:13:10.871 DEBUG:teuthology.orchestra.run.trial151:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T00:13:10.913 DEBUG:teuthology.orchestra.run.trial196:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T00:13:10.936 INFO:teuthology.orchestra.run.trial151.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.2.log 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-client.ceph-exporter.trial151.log 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.7.log 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.cephadm.log 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-client.ceph-exporter.trial151.log: 90.8% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-client.ceph-exporter.trial151.log.gz 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.4.log 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.audit.log 2026-02-17T00:13:10.937 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-volume.log 2026-02-17T00:13:10.938 INFO:teuthology.orchestra.run.trial151.stderr: 83.8% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.cephadm.log.gz 2026-02-17T00:13:10.938 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mon.trial151.log 2026-02-17T00:13:10.938 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.1.log 2026-02-17T00:13:10.938 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mon.trial151.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mgr.trial151.mmtaxh.log 2026-02-17T00:13:10.938 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.log 2026-02-17T00:13:10.939 INFO:teuthology.orchestra.run.trial196.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-17T00:13:10.939 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mgr.trial151.mmtaxh.log: 91.0% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.audit.log.gz 2026-02-17T00:13:10.939 INFO:teuthology.orchestra.run.trial151.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.log: 83.9% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.log.gz 2026-02-17T00:13:10.942 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.0.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.3.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.5.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.0.log: /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.cephadm.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mon.trial196.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.audit.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr: 82.5% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.cephadm.log.gz 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-volume.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mon.trial196.log: /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.6.log 2026-02-17T00:13:10.943 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mgr.trial196.ogdszw.log 2026-02-17T00:13:10.944 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.log 2026-02-17T00:13:10.944 INFO:teuthology.orchestra.run.trial196.stderr: 91.0% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.audit.log.gz/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mgr.trial196.ogdszw.log: 2026-02-17T00:13:10.944 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-client.ceph-exporter.trial196.log 2026-02-17T00:13:10.944 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.log: /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-client.ceph-exporter.trial196.log: 30.6% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-client.ceph-exporter.trial196.log.gz 2026-02-17T00:13:10.944 INFO:teuthology.orchestra.run.trial196.stderr: 82.8% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph.log.gz 2026-02-17T00:13:10.944 INFO:teuthology.orchestra.run.trial196.stderr: 90.9% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mgr.trial196.ogdszw.log.gz 2026-02-17T00:13:10.945 INFO:teuthology.orchestra.run.trial151.stderr: 93.2% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.7.log.gz 2026-02-17T00:13:10.945 INFO:teuthology.orchestra.run.trial151.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-17T00:13:10.945 INFO:teuthology.orchestra.run.trial151.stderr: 93.2% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.4.log.gz 2026-02-17T00:13:10.948 INFO:teuthology.orchestra.run.trial151.stderr: 95.9% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-volume.log.gz 2026-02-17T00:13:10.950 INFO:teuthology.orchestra.run.trial151.stderr: 93.8% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.1.log.gz 2026-02-17T00:13:10.950 INFO:teuthology.orchestra.run.trial196.stderr: 95.8% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-volume.log.gz 2026-02-17T00:13:10.951 INFO:teuthology.orchestra.run.trial196.stderr: 93.1% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.0.log.gz 2026-02-17T00:13:10.952 INFO:teuthology.orchestra.run.trial151.stderr: 94.3% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.2.log.gz 2026-02-17T00:13:10.956 INFO:teuthology.orchestra.run.trial196.stderr: 93.1% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.5.log.gz 2026-02-17T00:13:10.961 INFO:teuthology.orchestra.run.trial196.stderr: 94.1% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.3.log.gz 2026-02-17T00:13:10.962 INFO:teuthology.orchestra.run.trial196.stderr: 92.5% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mon.trial196.log.gz 2026-02-17T00:13:10.987 INFO:teuthology.orchestra.run.trial196.stderr: 94.2% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-osd.6.log.gz 2026-02-17T00:13:10.987 INFO:teuthology.orchestra.run.trial151.stderr: 89.9% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mgr.trial151.mmtaxh.log.gz 2026-02-17T00:13:10.988 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-17T00:13:10.988 INFO:teuthology.orchestra.run.trial196.stderr:real 0m0.057s 2026-02-17T00:13:10.988 INFO:teuthology.orchestra.run.trial196.stderr:user 0m0.122s 2026-02-17T00:13:10.989 INFO:teuthology.orchestra.run.trial196.stderr:sys 0m0.024s 2026-02-17T00:13:11.017 INFO:teuthology.orchestra.run.trial151.stderr: 91.9% -- replaced with /var/log/ceph/05b70b75-0b95-11f1-8c5c-d404e6e7d460/ceph-mon.trial151.log.gz 2026-02-17T00:13:11.019 INFO:teuthology.orchestra.run.trial151.stderr: 2026-02-17T00:13:11.019 INFO:teuthology.orchestra.run.trial151.stderr:real 0m0.093s 2026-02-17T00:13:11.019 INFO:teuthology.orchestra.run.trial151.stderr:user 0m0.197s 2026-02-17T00:13:11.019 INFO:teuthology.orchestra.run.trial151.stderr:sys 0m0.033s 2026-02-17T00:13:11.019 INFO:tasks.cephadm:Archiving logs... 2026-02-17T00:13:11.020 DEBUG:teuthology.misc:Transferring archived files from trial151:/var/log/ceph to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337/remote/trial151/log 2026-02-17T00:13:11.021 DEBUG:teuthology.orchestra.run.trial151:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T00:13:11.157 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/log/ceph to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337/remote/trial196/log 2026-02-17T00:13:11.158 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T00:13:11.227 INFO:tasks.cephadm:Removing cluster... 2026-02-17T00:13:11.228 DEBUG:teuthology.orchestra.run.trial151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 --force 2026-02-17T00:13:11.345 INFO:teuthology.orchestra.run.trial151.stdout:Deleting cluster with fsid: 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:13:11.434 DEBUG:teuthology.orchestra.run.trial196:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 05b70b75-0b95-11f1-8c5c-d404e6e7d460 --force 2026-02-17T00:13:11.548 INFO:teuthology.orchestra.run.trial196.stdout:Deleting cluster with fsid: 05b70b75-0b95-11f1-8c5c-d404e6e7d460 2026-02-17T00:13:11.635 INFO:tasks.cephadm:Removing cephadm ... 2026-02-17T00:13:11.635 DEBUG:teuthology.orchestra.run.trial151:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T00:13:11.652 DEBUG:teuthology.orchestra.run.trial196:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T00:13:11.670 INFO:tasks.cephadm:Teardown complete 2026-02-17T00:13:11.670 DEBUG:teuthology.run_tasks:Unwinding manager nvme_loop 2026-02-17T00:13:11.684 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial151:/dev/vg_nvme/lv_1... 2026-02-17T00:13:11.685 DEBUG:teuthology.orchestra.run.trial151:> sudo nvme disconnect -n lv_1 2026-02-17T00:13:11.951 INFO:teuthology.orchestra.run.trial151.stdout:NQN:lv_1 disconnected 1 controller(s) 2026-02-17T00:13:11.953 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial151:/dev/vg_nvme/lv_2... 2026-02-17T00:13:11.953 DEBUG:teuthology.orchestra.run.trial151:> sudo nvme disconnect -n lv_2 2026-02-17T00:13:12.227 INFO:teuthology.orchestra.run.trial151.stdout:NQN:lv_2 disconnected 1 controller(s) 2026-02-17T00:13:12.229 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial151:/dev/vg_nvme/lv_3... 2026-02-17T00:13:12.230 DEBUG:teuthology.orchestra.run.trial151:> sudo nvme disconnect -n lv_3 2026-02-17T00:13:12.490 INFO:teuthology.orchestra.run.trial151.stdout:NQN:lv_3 disconnected 1 controller(s) 2026-02-17T00:13:12.492 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial151:/dev/vg_nvme/lv_4... 2026-02-17T00:13:12.492 DEBUG:teuthology.orchestra.run.trial151:> sudo nvme disconnect -n lv_4 2026-02-17T00:13:12.747 INFO:teuthology.orchestra.run.trial151.stdout:NQN:lv_4 disconnected 1 controller(s) 2026-02-17T00:13:12.749 DEBUG:teuthology.orchestra.run.trial151:> set -ex 2026-02-17T00:13:12.749 DEBUG:teuthology.orchestra.run.trial151:> sudo dd of=/scratch_devs 2026-02-17T00:13:12.773 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial196:/dev/vg_nvme/lv_1... 2026-02-17T00:13:12.773 DEBUG:teuthology.orchestra.run.trial196:> sudo nvme disconnect -n lv_1 2026-02-17T00:13:13.021 INFO:teuthology.orchestra.run.trial196.stdout:NQN:lv_1 disconnected 1 controller(s) 2026-02-17T00:13:13.023 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial196:/dev/vg_nvme/lv_2... 2026-02-17T00:13:13.023 DEBUG:teuthology.orchestra.run.trial196:> sudo nvme disconnect -n lv_2 2026-02-17T00:13:13.275 INFO:teuthology.orchestra.run.trial196.stdout:NQN:lv_2 disconnected 1 controller(s) 2026-02-17T00:13:13.277 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial196:/dev/vg_nvme/lv_3... 2026-02-17T00:13:13.277 DEBUG:teuthology.orchestra.run.trial196:> sudo nvme disconnect -n lv_3 2026-02-17T00:13:13.538 INFO:teuthology.orchestra.run.trial196.stdout:NQN:lv_3 disconnected 1 controller(s) 2026-02-17T00:13:13.539 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial196:/dev/vg_nvme/lv_4... 2026-02-17T00:13:13.540 DEBUG:teuthology.orchestra.run.trial196:> sudo nvme disconnect -n lv_4 2026-02-17T00:13:13.794 INFO:teuthology.orchestra.run.trial196.stdout:NQN:lv_4 disconnected 1 controller(s) 2026-02-17T00:13:13.796 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T00:13:13.796 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/scratch_devs 2026-02-17T00:13:13.819 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T00:13:13.835 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T00:13:13.836 DEBUG:teuthology.orchestra.run.trial151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:13:13.839 DEBUG:teuthology.orchestra.run.trial196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:13:13.852 INFO:teuthology.orchestra.run.trial151.stderr:bash: line 1: ntpq: command not found 2026-02-17T00:13:13.868 INFO:teuthology.orchestra.run.trial151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T00:13:13.869 INFO:teuthology.orchestra.run.trial151.stdout:=============================================================================== 2026-02-17T00:13:13.869 INFO:teuthology.orchestra.run.trial151.stdout:^- cambria.bitsrc.net 2 6 77 59 +2293us[+2511us] +/- 85ms 2026-02-17T00:13:13.869 INFO:teuthology.orchestra.run.trial151.stdout:^* ntp.netlinkify.com 2 6 77 59 +24us[ +242us] +/- 7240us 2026-02-17T00:13:13.869 INFO:teuthology.orchestra.run.trial151.stdout:^- rn-03.koehn.com 2 6 77 59 +99us[ +99us] +/- 38ms 2026-02-17T00:13:13.869 INFO:teuthology.orchestra.run.trial151.stdout:^- frumentum-zeus.infra.fru> 2 6 77 59 -1610us[-1610us] +/- 24ms 2026-02-17T00:13:13.876 INFO:teuthology.orchestra.run.trial196.stderr:bash: line 1: ntpq: command not found 2026-02-17T00:13:13.905 INFO:teuthology.orchestra.run.trial196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T00:13:13.906 INFO:teuthology.orchestra.run.trial196.stdout:=============================================================================== 2026-02-17T00:13:13.906 INFO:teuthology.orchestra.run.trial196.stdout:^- baron.cgee.net 2 6 77 59 +567us[ +567us] +/- 25ms 2026-02-17T00:13:13.906 INFO:teuthology.orchestra.run.trial196.stdout:^+ time.cloudflare.com 3 6 77 59 -72us[ -121us] +/- 7142us 2026-02-17T00:13:13.906 INFO:teuthology.orchestra.run.trial196.stdout:^* nyc3.us.ntp.li 2 6 77 59 +7767ns[ -41us] +/- 2537us 2026-02-17T00:13:13.906 INFO:teuthology.orchestra.run.trial196.stdout:^- time1.lshiy.com 2 6 77 58 -117us[ -117us] +/- 143ms 2026-02-17T00:13:13.906 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T00:13:13.921 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T00:13:13.921 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T00:13:13.936 DEBUG:teuthology.orchestra.run.trial151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T00:13:13.995 DEBUG:teuthology.orchestra.run.trial196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T00:13:14.051 DEBUG:teuthology.orchestra.run.trial151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T00:13:14.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:13:14.078 DEBUG:teuthology.orchestra.run.trial196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T00:13:14.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:13:14.105 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T00:13:14.121 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T00:13:14.138 INFO:teuthology.task.internal:Duration was 367.983106 seconds 2026-02-17T00:13:14.138 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T00:13:14.155 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T00:13:14.155 DEBUG:teuthology.orchestra.run.trial151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T00:13:14.158 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T00:13:14.193 INFO:teuthology.orchestra.run.trial151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T00:13:14.195 INFO:teuthology.orchestra.run.trial196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T00:13:14.397 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T00:13:14.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial151.front.sepia.ceph.com 2026-02-17T00:13:14.398 DEBUG:teuthology.orchestra.run.trial151:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T00:13:14.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial196.front.sepia.ceph.com 2026-02-17T00:13:14.441 DEBUG:teuthology.orchestra.run.trial196:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T00:13:14.458 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T00:13:14.459 DEBUG:teuthology.orchestra.run.trial151:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T00:13:14.483 DEBUG:teuthology.orchestra.run.trial196:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T00:13:14.613 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T00:13:14.613 DEBUG:teuthology.orchestra.run.trial151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T00:13:14.615 DEBUG:teuthology.orchestra.run.trial196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T00:13:14.637 INFO:teuthology.orchestra.run.trial151.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:13:14.637 INFO:teuthology.orchestra.run.trial151.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:13:14.637 INFO:teuthology.orchestra.run.trial151.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T00:13:14.637 INFO:teuthology.orchestra.run.trial151.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T00:13:14.637 INFO:teuthology.orchestra.run.trial151.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T00:13:14.639 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:13:14.640 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:13:14.640 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T00:13:14.640 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T00:13:14.640 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T00:13:14.654 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 85.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T00:13:14.662 INFO:teuthology.orchestra.run.trial151.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T00:13:14.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T00:13:14.682 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T00:13:14.682 DEBUG:teuthology.orchestra.run.trial151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T00:13:14.728 DEBUG:teuthology.orchestra.run.trial196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T00:13:14.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T00:13:14.773 DEBUG:teuthology.orchestra.run.trial151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:13:14.775 DEBUG:teuthology.orchestra.run.trial196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:13:14.798 INFO:teuthology.orchestra.run.trial151.stdout:kernel.core_pattern = core 2026-02-17T00:13:14.820 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern = core 2026-02-17T00:13:14.850 DEBUG:teuthology.orchestra.run.trial151:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:13:14.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:13:14.871 DEBUG:teuthology.orchestra.run.trial196:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:13:14.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:13:14.906 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T00:13:14.924 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T00:13:14.925 DEBUG:teuthology.misc:Transferring archived files from trial151:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337/remote/trial151 2026-02-17T00:13:14.925 DEBUG:teuthology.orchestra.run.trial151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T00:13:14.957 DEBUG:teuthology.misc:Transferring archived files from trial196:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50337/remote/trial196 2026-02-17T00:13:14.957 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T00:13:14.986 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T00:13:14.986 DEBUG:teuthology.orchestra.run.trial151:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T00:13:14.992 DEBUG:teuthology.orchestra.run.trial196:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T00:13:15.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T00:13:15.061 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T00:13:15.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T00:13:15.080 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T00:13:15.080 DEBUG:teuthology.orchestra.run.trial151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T00:13:15.083 DEBUG:teuthology.orchestra.run.trial196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T00:13:15.098 INFO:teuthology.orchestra.run.trial151.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 00:13 /home/ubuntu/cephtest 2026-02-17T00:13:15.101 INFO:teuthology.orchestra.run.trial196.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 00:13 /home/ubuntu/cephtest 2026-02-17T00:13:15.102 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T00:13:15.122 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T00:13:15.163 INFO:teuthology.run:Summary data: description: orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} duration: 367.98310589790344 owner: scheduled_dgalloway@soko04.front.sepia.ceph.com success: true 2026-02-17T00:13:15.164 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T00:13:15.292 INFO:teuthology.run:pass