2026-02-12T10:53:52.126 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T10:53:52.141 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:53:52.215 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340 branch: wip-squid-pr-67199-kefu-1 description: rados:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} email: null first_in_suite: false flavor: default job_id: '43340' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-squid-pr-67199-kefu-1 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - OSD_DOWN - CEPHADM_FAILED_DAEMON - but it is still running - PG_DEGRADED log-only-match: - CEPHADM_ sha1: 05b55d192f002ad5df41409624b8d176527d0841 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 05b55d192f002ad5df41409624b8d176527d0841 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-squid-pr-67199-kefu-1 sha1: 05b55d192f002ad5df41409624b8d176527d0841 owner: scheduled_dgalloway@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - - host.b - client.1 seed: 7179 sha1: 05b55d192f002ad5df41409624b8d176527d0841 sleep_before_teardown: 0 subset: 110/120000 suite: rados:cephadm suite_branch: wip-squid-pr-67199-kefu-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 05b55d192f002ad5df41409624b8d176527d0841 targets: trial031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEA0IxU8Znz1GyR0VBi8S6slkOapSCXEBDwtuYcngHZ6O+pRF2kWjL/qCC/o8UTve1t9D7gyGLWJufzWHkb4y8U= trial069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBxtge9zvZu2yfXBosIRNykJ3J4bmgBT8l9oSs8G+RzS8zUH4D5WzInCjHKTK6AdtDkQZOrLGsUoA60bov+UMok= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - nvme_loop: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - ceph orch ls | grep '^osd.all-available-devices ' - cephadm.shell: host.a: - "set -e\nset -x\nceph orch ps\nceph orch device ls\nceph osd tree\nfor osd in\ \ `ceph osd ls` ; do\n ceph orch osd rm $osd --force --zap --replace\ndone\n\ while ceph orch osd rm ls | wc | grep ^1 ; do sleep 10 ; done\n" teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c433f1062990a0488dc29a553589bc609a460691 timestamp: 2026-02-10_16:16:29 tube: trial user: dgalloway verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T10:53:52.216 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa; will attempt to use it 2026-02-12T10:53:52.216 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa/tasks 2026-02-12T10:53:52.216 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T10:53:52.218 INFO:teuthology.task.internal:Checking packages... 2026-02-12T10:53:52.218 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '05b55d192f002ad5df41409624b8d176527d0841' 2026-02-12T10:53:52.218 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T10:53:52.218 INFO:teuthology.packaging:ref: None 2026-02-12T10:53:52.218 INFO:teuthology.packaging:tag: None 2026-02-12T10:53:52.218 INFO:teuthology.packaging:branch: wip-squid-pr-67199-kefu-1 2026-02-12T10:53:52.218 INFO:teuthology.packaging:sha1: 05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:53:52.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-squid-pr-67199-kefu-1 2026-02-12T10:53:52.332 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-680.g05b55d19 2026-02-12T10:53:52.332 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T10:53:52.344 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T10:53:52.344 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T10:53:52.359 INFO:teuthology.task.internal:Saving configuration 2026-02-12T10:53:52.370 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T10:53:52.382 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T10:53:52.707 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial031.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 10:50:38.227169', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEA0IxU8Znz1GyR0VBi8S6slkOapSCXEBDwtuYcngHZ6O+pRF2kWjL/qCC/o8UTve1t9D7gyGLWJufzWHkb4y8U='} 2026-02-12T10:53:52.761 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial069.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 10:50:38.226562', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBxtge9zvZu2yfXBosIRNykJ3J4bmgBT8l9oSs8G+RzS8zUH4D5WzInCjHKTK6AdtDkQZOrLGsUoA60bov+UMok='} 2026-02-12T10:53:52.761 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T10:53:52.772 INFO:teuthology.task.internal:roles: ubuntu@trial031.front.sepia.ceph.com - ['host.a', 'client.0'] 2026-02-12T10:53:52.772 INFO:teuthology.task.internal:roles: ubuntu@trial069.front.sepia.ceph.com - ['host.b', 'client.1'] 2026-02-12T10:53:52.772 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T10:53:52.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x71434b5280e0>, signals=[15]) 2026-02-12T10:53:52.909 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T10:53:52.921 INFO:teuthology.task.internal:Opening connections... 2026-02-12T10:53:52.921 DEBUG:teuthology.task.internal:connecting to ubuntu@trial031.front.sepia.ceph.com 2026-02-12T10:53:52.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:53:52.982 DEBUG:teuthology.task.internal:connecting to ubuntu@trial069.front.sepia.ceph.com 2026-02-12T10:53:52.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:53:53.041 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T10:53:53.053 DEBUG:teuthology.orchestra.run.trial031:> uname -m 2026-02-12T10:53:53.068 INFO:teuthology.orchestra.run.trial031.stdout:x86_64 2026-02-12T10:53:53.068 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:NAME="CentOS Stream" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="9" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:ID="centos" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="9" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;31" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:53:53.124 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:53:53.125 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server 2026-02-12T10:53:53.197 DEBUG:teuthology.orchestra.run.trial069:> uname -m 2026-02-12T10:53:53.212 INFO:teuthology.orchestra.run.trial069.stdout:x86_64 2026-02-12T10:53:53.212 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:53:53.268 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:53:53.269 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server 2026-02-12T10:53:53.331 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T10:53:53.344 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T10:53:53.357 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T10:53:53.357 DEBUG:teuthology.orchestra.run.trial031:> test '!' -e /home/ubuntu/cephtest 2026-02-12T10:53:53.359 DEBUG:teuthology.orchestra.run.trial069:> test '!' -e /home/ubuntu/cephtest 2026-02-12T10:53:53.374 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T10:53:53.386 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T10:53:53.386 DEBUG:teuthology.orchestra.run.trial031:> test -z $(ls -A /var/lib/ceph) 2026-02-12T10:53:53.414 DEBUG:teuthology.orchestra.run.trial069:> test -z $(ls -A /var/lib/ceph) 2026-02-12T10:53:53.431 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T10:53:53.582 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T10:53:53.601 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T10:53:53.601 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T10:53:53.601 DEBUG:teuthology.orchestra.run.trial031:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T10:53:53.601 DEBUG:teuthology.orchestra.run.trial069:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T10:53:53.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:53:53.616 DEBUG:teuthology.orchestra.run.trial069:> uname -r 2026-02-12T10:53:53.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:53:53.616 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T10:53:53.671 INFO:teuthology.orchestra.run.trial031.stdout:5.14.0-645.el9.x86_64 2026-02-12T10:53:53.672 INFO:teuthology.task.kernel:Running kernel on trial031: 5.14.0-645.el9.x86_64 2026-02-12T10:53:53.672 DEBUG:teuthology.orchestra.run.trial031:> sudo yum install -y kernel 2026-02-12T10:53:53.672 INFO:teuthology.orchestra.run.trial069.stdout:5.14.0-645.el9.x86_64 2026-02-12T10:53:53.672 INFO:teuthology.task.kernel:Running kernel on trial069: 5.14.0-645.el9.x86_64 2026-02-12T10:53:53.672 DEBUG:teuthology.orchestra.run.trial069:> sudo yum install -y kernel 2026-02-12T10:53:54.878 INFO:teuthology.orchestra.run.trial069.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-12T10:53:55.201 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.9 MB 00:01 2026-02-12T10:53:58.203 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T10:54:08.921 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - CRB 956 kB/s | 7.8 MB 00:08 2026-02-12T10:54:09.775 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - Extras packages 147 kB/s | 20 kB 00:00 2026-02-12T10:54:10.312 INFO:teuthology.orchestra.run.trial031.stdout:Extra Packages for Enterprise Linux 44 MB/s | 20 MB 00:00 2026-02-12T10:54:13.628 INFO:teuthology.orchestra.run.trial031.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-12T10:54:14.688 INFO:teuthology.orchestra.run.trial031.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T10:54:14.708 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-12T10:54:14.709 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T10:54:14.709 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-12T10:54:14.709 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T10:54:14.710 INFO:teuthology.orchestra.run.trial031.stdout:Install 4 Packages 2026-02-12T10:54:14.711 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:54:14.711 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 88 M 2026-02-12T10:54:14.711 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 135 M 2026-02-12T10:54:14.711 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-12T10:54:14.806 INFO:teuthology.orchestra.run.trial031.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 22 MB/s | 768 kB 00:00 2026-02-12T10:54:14.867 INFO:teuthology.orchestra.run.trial031.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 180 MB/s | 17 MB 00:00 2026-02-12T10:54:15.010 INFO:teuthology.orchestra.run.trial031.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 152 MB/s | 31 MB 00:00 2026-02-12T10:54:15.205 INFO:teuthology.orchestra.run.trial031.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 92 MB/s | 40 MB 00:00 2026-02-12T10:54:15.205 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:54:15.205 INFO:teuthology.orchestra.run.trial031.stdout:Total 178 MB/s | 88 MB 00:00 2026-02-12T10:54:15.393 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-12T10:54:15.603 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-12T10:54:15.603 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-12T10:54:15.949 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-12T10:54:15.949 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-12T10:54:17.046 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-12T10:54:17.334 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:54:17.354 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:54:17.485 INFO:teuthology.orchestra.run.trial069.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 27 MB 00:22 2026-02-12T10:54:19.122 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:54:19.151 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:54:20.878 INFO:teuthology.orchestra.run.trial069.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-12T10:54:22.173 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:54:22.180 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:22.382 INFO:teuthology.orchestra.run.trial069.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 20 kB 00:00 2026-02-12T10:54:22.983 INFO:teuthology.orchestra.run.trial069.stdout:Extra Packages for Enterprise Linux 38 MB/s | 20 MB 00:00 2026-02-12T10:54:25.219 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:26.155 INFO:teuthology.orchestra.run.trial069.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-12T10:54:27.226 INFO:teuthology.orchestra.run.trial069.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T10:54:27.245 INFO:teuthology.orchestra.run.trial069.stdout:Dependencies resolved. 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout:================================================================================ 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout: Package Architecture Version Repository Size 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout:================================================================================ 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout:Installing: 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout:Installing dependencies: 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T10:54:27.247 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:54:27.248 INFO:teuthology.orchestra.run.trial069.stdout:Transaction Summary 2026-02-12T10:54:27.248 INFO:teuthology.orchestra.run.trial069.stdout:================================================================================ 2026-02-12T10:54:27.248 INFO:teuthology.orchestra.run.trial069.stdout:Install 4 Packages 2026-02-12T10:54:27.248 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:54:27.248 INFO:teuthology.orchestra.run.trial069.stdout:Total download size: 88 M 2026-02-12T10:54:27.248 INFO:teuthology.orchestra.run.trial069.stdout:Installed size: 135 M 2026-02-12T10:54:27.248 INFO:teuthology.orchestra.run.trial069.stdout:Downloading Packages: 2026-02-12T10:54:28.411 INFO:teuthology.orchestra.run.trial069.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 713 kB/s | 768 kB 00:01 2026-02-12T10:54:30.606 INFO:teuthology.orchestra.run.trial069.stdout:(2/4): kernel-modules-core-5.14.0-677.el9.x86_6 14 MB/s | 31 MB 00:02 2026-02-12T10:54:33.873 INFO:teuthology.orchestra.run.trial069.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 6.1 MB/s | 40 MB 00:06 2026-02-12T10:54:39.171 INFO:teuthology.orchestra.run.trial069.stdout:(4/4): kernel-core-5.14.0-677.el9.x86_64.rpm 1.4 MB/s | 17 MB 00:11 2026-02-12T10:54:39.173 INFO:teuthology.orchestra.run.trial069.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:54:39.173 INFO:teuthology.orchestra.run.trial069.stdout:Total 7.4 MB/s | 88 MB 00:11 2026-02-12T10:54:39.360 INFO:teuthology.orchestra.run.trial069.stdout:Running transaction check 2026-02-12T10:54:39.558 INFO:teuthology.orchestra.run.trial069.stdout:Transaction check succeeded. 2026-02-12T10:54:39.558 INFO:teuthology.orchestra.run.trial069.stdout:Running transaction test 2026-02-12T10:54:39.901 INFO:teuthology.orchestra.run.trial069.stdout:Transaction test succeeded. 2026-02-12T10:54:39.902 INFO:teuthology.orchestra.run.trial069.stdout:Running transaction 2026-02-12T10:54:40.981 INFO:teuthology.orchestra.run.trial069.stdout: Preparing : 1/1 2026-02-12T10:54:41.263 INFO:teuthology.orchestra.run.trial069.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:54:41.282 INFO:teuthology.orchestra.run.trial069.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:54:43.033 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:54:43.061 INFO:teuthology.orchestra.run.trial069.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:54:46.084 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:54:46.091 INFO:teuthology.orchestra.run.trial069.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:49.124 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:55.698 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:55.720 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:55.786 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:55.786 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:54:55.786 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:54:55.786 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:54:55.838 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:54:55.838 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:54:55.838 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-12T10:54:55.838 INFO:teuthology.orchestra.run.trial031.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T10:54:55.839 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T10:54:55.839 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T10:54:55.839 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T10:54:55.839 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:54:55.839 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-12T10:54:55.897 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:54:55.922 INFO:teuthology.orchestra.run.trial031.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:54:55.924 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:54:55.924 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T10:54:55.924 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T10:54:55.924 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T10:54:55.924 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-12T10:54:55.924 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial031.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T10:54:55.924 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:54:55.988 INFO:teuthology.orchestra.run.trial031.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:54:55.989 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:54:55.990 DEBUG:teuthology.orchestra.run.trial031:> sudo rpm -qi grub2-tools 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Name : grub2-tools 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Epoch : 1 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Version : 2.06 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Release : 118.el9 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Architecture: x86_64 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Group : Unspecified 2026-02-12T10:54:56.060 INFO:teuthology.orchestra.run.trial031.stdout:Size : 8393909 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:License : GPLv3+ 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Packager : builder@centos.org 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Vendor : CentOS 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Summary : Support tools for GRUB. 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:Description : 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T10:54:56.061 INFO:teuthology.orchestra.run.trial031.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T10:54:56.062 INFO:teuthology.orchestra.run.trial031.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T10:54:56.062 INFO:teuthology.orchestra.run.trial031.stdout:hardware devices. 2026-02-12T10:54:56.062 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:54:56.062 INFO:teuthology.orchestra.run.trial031.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T10:54:56.063 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T10:54:56.063 INFO:teuthology.task.kernel:Updating grub on trial031 to boot 5.14.0-677.el9.x86_64 2026-02-12T10:54:56.063 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T10:54:56.126 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T10:54:56.128 DEBUG:teuthology.orchestra.run.trial031:> sudo command -v grubby && echo yes || echo no 2026-02-12T10:54:56.194 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/grubby 2026-02-12T10:54:56.195 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-12T10:54:56.195 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T10:54:56.260 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T10:54:56.261 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T10:54:56.333 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T10:54:56.541 INFO:teuthology.orchestra.run.trial031.stderr:Generating grub configuration file ... 2026-02-12T10:54:56.604 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T10:54:56.610 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T10:54:56.860 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T10:54:56.866 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T10:54:56.898 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T10:54:56.904 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T10:54:56.928 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T10:54:56.935 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T10:54:57.016 INFO:teuthology.orchestra.run.trial031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T10:54:57.023 INFO:teuthology.orchestra.run.trial031.stderr:done 2026-02-12T10:54:57.026 DEBUG:teuthology.orchestra.run.trial031:> test -d /sys/firmware/efi 2026-02-12T10:54:57.042 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T10:54:57.107 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/BOOT 2026-02-12T10:54:57.107 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/centos 2026-02-12T10:54:57.109 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T10:54:57.175 INFO:teuthology.orchestra.run.trial031.stdout:no 2026-02-12T10:54:57.176 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T10:54:57.239 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-12T10:54:57.240 DEBUG:teuthology.orchestra.run.trial031:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T10:54:57.304 DEBUG:teuthology.orchestra.run.trial031:> sudo shutdown -r now 2026-02-12T10:54:57.376 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T10:55:19.540 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:55:19.562 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:55:19.625 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:55:19.625 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:55:19.625 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:55:19.625 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:55:19.678 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:55:19.678 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:55:19.678 INFO:teuthology.orchestra.run.trial069.stdout:Installed: 2026-02-12T10:55:19.678 INFO:teuthology.orchestra.run.trial069.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T10:55:19.678 INFO:teuthology.orchestra.run.trial069.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T10:55:19.679 INFO:teuthology.orchestra.run.trial069.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T10:55:19.679 INFO:teuthology.orchestra.run.trial069.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T10:55:19.679 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:55:19.679 INFO:teuthology.orchestra.run.trial069.stdout:Complete! 2026-02-12T10:55:19.734 DEBUG:teuthology.orchestra.run.trial069:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:55:19.759 INFO:teuthology.orchestra.run.trial069.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:55:19.760 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:55:19.760 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T10:55:19.760 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T10:55:19.760 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T10:55:19.760 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-12T10:55:19.761 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial069.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T10:55:19.761 DEBUG:teuthology.orchestra.run.trial069:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:55:19.822 INFO:teuthology.orchestra.run.trial069.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:55:19.823 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:55:19.823 DEBUG:teuthology.orchestra.run.trial069:> sudo rpm -qi grub2-tools 2026-02-12T10:55:19.891 INFO:teuthology.orchestra.run.trial069.stdout:Name : grub2-tools 2026-02-12T10:55:19.891 INFO:teuthology.orchestra.run.trial069.stdout:Epoch : 1 2026-02-12T10:55:19.891 INFO:teuthology.orchestra.run.trial069.stdout:Version : 2.06 2026-02-12T10:55:19.891 INFO:teuthology.orchestra.run.trial069.stdout:Release : 118.el9 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Architecture: x86_64 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Group : Unspecified 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Size : 8393909 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:License : GPLv3+ 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Packager : builder@centos.org 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Vendor : CentOS 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T10:55:19.892 INFO:teuthology.orchestra.run.trial069.stdout:Summary : Support tools for GRUB. 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout:Description : 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout:hardware devices. 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:55:19.893 INFO:teuthology.orchestra.run.trial069.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T10:55:19.894 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T10:55:19.895 INFO:teuthology.task.kernel:Updating grub on trial069 to boot 5.14.0-677.el9.x86_64 2026-02-12T10:55:19.895 DEBUG:teuthology.orchestra.run.trial069:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T10:55:19.959 INFO:teuthology.orchestra.run.trial069.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T10:55:19.960 DEBUG:teuthology.orchestra.run.trial069:> sudo command -v grubby && echo yes || echo no 2026-02-12T10:55:20.024 INFO:teuthology.orchestra.run.trial069.stdout:/sbin/grubby 2026-02-12T10:55:20.025 INFO:teuthology.orchestra.run.trial069.stdout:yes 2026-02-12T10:55:20.026 DEBUG:teuthology.orchestra.run.trial069:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T10:55:20.091 INFO:teuthology.orchestra.run.trial069.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T10:55:20.092 DEBUG:teuthology.orchestra.run.trial069:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T10:55:20.166 DEBUG:teuthology.orchestra.run.trial069:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T10:55:20.372 INFO:teuthology.orchestra.run.trial069.stderr:Generating grub configuration file ... 2026-02-12T10:55:20.436 INFO:teuthology.orchestra.run.trial069.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T10:55:20.442 INFO:teuthology.orchestra.run.trial069.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T10:55:20.691 INFO:teuthology.orchestra.run.trial069.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T10:55:20.697 INFO:teuthology.orchestra.run.trial069.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T10:55:20.727 INFO:teuthology.orchestra.run.trial069.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T10:55:20.734 INFO:teuthology.orchestra.run.trial069.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T10:55:20.758 INFO:teuthology.orchestra.run.trial069.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T10:55:20.764 INFO:teuthology.orchestra.run.trial069.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T10:55:20.846 INFO:teuthology.orchestra.run.trial069.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T10:55:20.854 INFO:teuthology.orchestra.run.trial069.stderr:done 2026-02-12T10:55:20.856 DEBUG:teuthology.orchestra.run.trial069:> test -d /sys/firmware/efi 2026-02-12T10:55:20.872 DEBUG:teuthology.orchestra.run.trial069:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T10:55:20.937 INFO:teuthology.orchestra.run.trial069.stdout:/boot/efi/EFI/BOOT 2026-02-12T10:55:20.937 INFO:teuthology.orchestra.run.trial069.stdout:/boot/efi/EFI/centos 2026-02-12T10:55:20.939 DEBUG:teuthology.orchestra.run.trial069:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T10:55:21.004 INFO:teuthology.orchestra.run.trial069.stdout:no 2026-02-12T10:55:21.004 DEBUG:teuthology.orchestra.run.trial069:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T10:55:21.068 INFO:teuthology.orchestra.run.trial069.stdout:yes 2026-02-12T10:55:21.069 DEBUG:teuthology.orchestra.run.trial069:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T10:55:21.133 DEBUG:teuthology.orchestra.run.trial069:> sudo shutdown -r now 2026-02-12T10:55:21.205 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T10:55:27.353 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-12T10:55:27.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T10:55:27.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:55:51.200 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-12T10:55:51.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T10:55:51.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:56:05.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.69 2026-02-12T10:56:14.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T10:56:14.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:56:27.369 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T10:56:36.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T10:56:36.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:56:36.512 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T10:56:36.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T10:56:36.657 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T10:56:36.657 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T10:56:36.713 INFO:teuthology.orchestra.run.trial031.stdout:5.14.0-677.el9.x86_64 2026-02-12T10:56:36.713 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T10:56:36.713 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T10:56:36.713 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T10:56:37.714 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-12T10:56:37.715 DEBUG:teuthology.orchestra.run.trial031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T10:56:37.745 INFO:teuthology.orchestra.run.trial031.stdout:ttyS1 2026-02-12T10:56:37.768 DEBUG:teuthology.parallel:result is None 2026-02-12T10:56:50.596 DEBUG:teuthology.orchestra.run.trial069:> true 2026-02-12T10:56:50.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T10:56:50.751 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T10:56:50.751 DEBUG:teuthology.orchestra.run.trial069:> uname -r 2026-02-12T10:56:50.806 INFO:teuthology.orchestra.run.trial069.stdout:5.14.0-677.el9.x86_64 2026-02-12T10:56:50.807 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T10:56:50.807 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T10:56:50.807 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T10:56:51.807 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-12T10:56:51.807 DEBUG:teuthology.orchestra.run.trial069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T10:56:51.837 INFO:teuthology.orchestra.run.trial069.stdout:ttyS1 2026-02-12T10:56:51.870 DEBUG:teuthology.parallel:result is None 2026-02-12T10:56:51.870 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T10:56:51.882 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T10:56:51.882 DEBUG:teuthology.orchestra.run.trial031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T10:56:51.884 DEBUG:teuthology.orchestra.run.trial069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T10:56:51.926 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T10:56:51.936 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T10:56:51.951 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T10:56:51.951 DEBUG:teuthology.orchestra.run.trial031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T10:56:51.953 DEBUG:teuthology.orchestra.run.trial069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T10:56:51.988 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T10:56:52.000 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T10:56:52.000 DEBUG:teuthology.orchestra.run.trial031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T10:56:52.010 DEBUG:teuthology.orchestra.run.trial069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T10:56:52.032 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:56:52.040 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:56:52.047 INFO:teuthology.orchestra.run.trial069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:56:52.056 INFO:teuthology.orchestra.run.trial069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:56:52.057 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T10:56:52.069 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T10:56:52.070 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T10:56:52.084 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T10:56:52.123 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T10:56:52.139 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T10:56:52.139 DEBUG:teuthology.orchestra.run.trial031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T10:56:52.148 DEBUG:teuthology.orchestra.run.trial069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T10:56:52.179 DEBUG:teuthology.orchestra.run.trial031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:56:52.320 DEBUG:teuthology.orchestra.run.trial031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:56:52.346 DEBUG:teuthology.orchestra.run.trial031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:56:52.493 DEBUG:teuthology.orchestra.run.trial031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:56:52.528 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:56:52.528 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T10:56:52.596 DEBUG:teuthology.orchestra.run.trial069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:56:52.729 DEBUG:teuthology.orchestra.run.trial069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:56:52.754 DEBUG:teuthology.orchestra.run.trial069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:56:52.905 DEBUG:teuthology.orchestra.run.trial069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:56:52.930 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:56:52.930 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T10:56:52.995 DEBUG:teuthology.orchestra.run.trial031:> sudo service rsyslog restart 2026-02-12T10:56:52.998 DEBUG:teuthology.orchestra.run.trial069:> sudo service rsyslog restart 2026-02-12T10:56:53.025 INFO:teuthology.orchestra.run.trial031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:56:53.063 INFO:teuthology.orchestra.run.trial069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:56:53.581 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T10:56:53.592 INFO:teuthology.task.internal:Starting timer... 2026-02-12T10:56:53.592 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T10:56:53.610 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T10:56:53.623 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2026-02-12T10:56:53.623 DEBUG:teuthology.orchestra.run.trial031:> sudo service auditd rotate 2026-02-12T10:56:53.653 INFO:teuthology.orchestra.run.trial031.stdout:Rotating logs: 2026-02-12T10:56:53.655 DEBUG:teuthology.orchestra.run.trial069:> sudo service auditd rotate 2026-02-12T10:56:53.683 INFO:teuthology.orchestra.run.trial069.stdout:Rotating logs: 2026-02-12T10:56:53.685 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T10:56:53.685 DEBUG:teuthology.orchestra.run.trial031:> /usr/sbin/getenforce 2026-02-12T10:56:53.711 INFO:teuthology.orchestra.run.trial031.stdout:Permissive 2026-02-12T10:56:53.711 DEBUG:teuthology.orchestra.run.trial069:> /usr/sbin/getenforce 2026-02-12T10:56:53.741 INFO:teuthology.orchestra.run.trial069.stdout:Permissive 2026-02-12T10:56:53.741 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial031.front.sepia.ceph.com': 'permissive', 'ubuntu@trial069.front.sepia.ceph.com': 'permissive'} 2026-02-12T10:56:53.742 DEBUG:teuthology.orchestra.run.trial031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-12T10:56:53.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:53.776 DEBUG:teuthology.orchestra.run.trial069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-12T10:56:53.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:53.807 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T10:56:53.807 DEBUG:teuthology.orchestra.run.trial031:> sudo /usr/sbin/setenforce permissive 2026-02-12T10:56:53.839 DEBUG:teuthology.orchestra.run.trial069:> sudo /usr/sbin/setenforce permissive 2026-02-12T10:56:53.871 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T10:56:53.887 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T10:56:53.900 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T10:56:53.902 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial031.front.sepia.ceph.com,trial069.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T10:58:06.564 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial031.front.sepia.ceph.com'), Remote(name='ubuntu@trial069.front.sepia.ceph.com')] 2026-02-12T10:58:06.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T10:58:06.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:58:06.675 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T10:58:06.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T10:58:06.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T10:58:06.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:58:06.855 DEBUG:teuthology.orchestra.run.trial069:> true 2026-02-12T10:58:06.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com' 2026-02-12T10:58:06.933 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T10:58:06.946 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T10:58:06.947 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T10:58:06.947 DEBUG:teuthology.orchestra.run.trial031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:58:06.949 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T10:58:06.950 DEBUG:teuthology.orchestra.run.trial069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:58:06.975 INFO:teuthology.orchestra.run.trial031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T10:58:06.987 INFO:teuthology.orchestra.run.trial031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T10:58:06.999 INFO:teuthology.orchestra.run.trial069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T10:58:07.008 INFO:teuthology.orchestra.run.trial031.stderr:sudo: ntpd: command not found 2026-02-12T10:58:07.010 INFO:teuthology.orchestra.run.trial069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T10:58:07.017 INFO:teuthology.orchestra.run.trial031.stdout:506 Cannot talk to daemon 2026-02-12T10:58:07.030 INFO:teuthology.orchestra.run.trial031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T10:58:07.030 INFO:teuthology.orchestra.run.trial069.stderr:sudo: ntpd: command not found 2026-02-12T10:58:07.040 INFO:teuthology.orchestra.run.trial069.stdout:506 Cannot talk to daemon 2026-02-12T10:58:07.041 INFO:teuthology.orchestra.run.trial031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T10:58:07.051 INFO:teuthology.orchestra.run.trial069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T10:58:07.062 INFO:teuthology.orchestra.run.trial069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T10:58:07.088 INFO:teuthology.orchestra.run.trial031.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:58:07.106 INFO:teuthology.orchestra.run.trial069.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:58:07.107 INFO:teuthology.orchestra.run.trial031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:58:07.107 INFO:teuthology.orchestra.run.trial031.stdout:=============================================================================== 2026-02-12T10:58:07.107 INFO:teuthology.orchestra.run.trial031.stdout:^? 99-28-14-242.lightspeed.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.108 INFO:teuthology.orchestra.run.trial031.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.108 INFO:teuthology.orchestra.run.trial031.stdout:^? ntp.netlinkify.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.108 INFO:teuthology.orchestra.run.trial031.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.121 INFO:teuthology.orchestra.run.trial069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:58:07.121 INFO:teuthology.orchestra.run.trial069.stdout:=============================================================================== 2026-02-12T10:58:07.121 INFO:teuthology.orchestra.run.trial069.stdout:^? ntp6.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.121 INFO:teuthology.orchestra.run.trial069.stdout:^? 104.233.211.205 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.121 INFO:teuthology.orchestra.run.trial069.stdout:^? daisy.zia.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.121 INFO:teuthology.orchestra.run.trial069.stdout:^? chi3.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:58:07.123 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T10:58:07.142 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T10:58:07.143 DEBUG:teuthology.orchestra.run.trial031:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T10:58:07.143 DEBUG:teuthology.orchestra.run.trial069:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T10:58:07.150 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial031.front.sepia.ceph.com 2026-02-12T10:58:07.151 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-12T10:58:07.151 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-02-12T10:58:07.151 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-02-12T10:58:07.151 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-02-12T10:58:07.165 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial069.front.sepia.ceph.com 2026-02-12T10:58:07.166 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-12T10:58:07.166 INFO:teuthology.task.pexec:sudo dnf install runc nvmetcli nvme-cli -y 2026-02-12T10:58:07.166 INFO:teuthology.task.pexec:sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf 2026-02-12T10:58:07.166 INFO:teuthology.task.pexec:sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf 2026-02-12T10:58:07.323 INFO:teuthology.orchestra.run.trial031.stdout:No match for argument: nvme-cli 2026-02-12T10:58:07.323 INFO:teuthology.orchestra.run.trial031.stderr:No packages marked for removal. 2026-02-12T10:58:07.325 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-12T10:58:07.326 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-12T10:58:07.326 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-12T10:58:07.339 INFO:teuthology.orchestra.run.trial069.stdout:No match for argument: nvme-cli 2026-02-12T10:58:07.339 INFO:teuthology.orchestra.run.trial069.stderr:No packages marked for removal. 2026-02-12T10:58:07.341 INFO:teuthology.orchestra.run.trial069.stdout:Dependencies resolved. 2026-02-12T10:58:07.342 INFO:teuthology.orchestra.run.trial069.stdout:Nothing to do. 2026-02-12T10:58:07.342 INFO:teuthology.orchestra.run.trial069.stdout:Complete! 2026-02-12T10:58:07.625 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:31 ago on Thu 12 Feb 2026 10:57:36 AM UTC. 2026-02-12T10:58:07.635 INFO:teuthology.orchestra.run.trial069.stdout:Last metadata expiration check: 0:00:31 ago on Thu 12 Feb 2026 10:57:36 AM UTC. 2026-02-12T10:58:07.707 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-12T10:58:07.708 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T10:58:07.708 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repository Size 2026-02-12T10:58:07.708 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T10:58:07.708 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-12T10:58:07.708 INFO:teuthology.orchestra.run.trial031.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-12T10:58:07.708 INFO:teuthology.orchestra.run.trial031.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-12T10:58:07.708 INFO:teuthology.orchestra.run.trial031.stdout: runc x86_64 4:1.4.0-1.el9 appstream 4.0 M 2026-02-12T10:58:07.709 INFO:teuthology.orchestra.run.trial031.stdout:Upgrading: 2026-02-12T10:58:07.709 INFO:teuthology.orchestra.run.trial031.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-12T10:58:07.709 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-12T10:58:07.709 INFO:teuthology.orchestra.run.trial031.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-12T10:58:07.709 INFO:teuthology.orchestra.run.trial031.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-12T10:58:07.709 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T10:58:07.710 INFO:teuthology.orchestra.run.trial031.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-12T10:58:07.710 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:07.710 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-12T10:58:07.710 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T10:58:07.710 INFO:teuthology.orchestra.run.trial031.stdout:Install 7 Packages 2026-02-12T10:58:07.710 INFO:teuthology.orchestra.run.trial031.stdout:Upgrade 1 Package 2026-02-12T10:58:07.711 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:07.712 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 6.4 M 2026-02-12T10:58:07.712 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-12T10:58:07.717 INFO:teuthology.orchestra.run.trial069.stdout:Dependencies resolved. 2026-02-12T10:58:07.718 INFO:teuthology.orchestra.run.trial069.stdout:================================================================================ 2026-02-12T10:58:07.718 INFO:teuthology.orchestra.run.trial069.stdout: Package Arch Version Repository Size 2026-02-12T10:58:07.718 INFO:teuthology.orchestra.run.trial069.stdout:================================================================================ 2026-02-12T10:58:07.718 INFO:teuthology.orchestra.run.trial069.stdout:Installing: 2026-02-12T10:58:07.718 INFO:teuthology.orchestra.run.trial069.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-12T10:58:07.718 INFO:teuthology.orchestra.run.trial069.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout: runc x86_64 4:1.4.0-1.el9 appstream 4.0 M 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout:Upgrading: 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout:Installing dependencies: 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T10:58:07.719 INFO:teuthology.orchestra.run.trial069.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-12T10:58:07.720 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:58:07.720 INFO:teuthology.orchestra.run.trial069.stdout:Transaction Summary 2026-02-12T10:58:07.720 INFO:teuthology.orchestra.run.trial069.stdout:================================================================================ 2026-02-12T10:58:07.720 INFO:teuthology.orchestra.run.trial069.stdout:Install 7 Packages 2026-02-12T10:58:07.720 INFO:teuthology.orchestra.run.trial069.stdout:Upgrade 1 Package 2026-02-12T10:58:07.720 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:58:07.721 INFO:teuthology.orchestra.run.trial069.stdout:Total download size: 6.4 M 2026-02-12T10:58:07.721 INFO:teuthology.orchestra.run.trial069.stdout:Downloading Packages: 2026-02-12T10:58:07.957 INFO:teuthology.orchestra.run.trial069.stdout:(1/8): nvmetcli-0.8-3.el9.noarch.rpm 466 kB/s | 44 kB 00:00 2026-02-12T10:58:07.959 INFO:teuthology.orchestra.run.trial069.stdout:(2/8): python3-configshell-1.1.30-1.el9.noarch. 746 kB/s | 72 kB 00:00 2026-02-12T10:58:08.001 INFO:teuthology.orchestra.run.trial069.stdout:(3/8): python3-kmod-0.9-32.el9.x86_64.rpm 1.9 MB/s | 84 kB 00:00 2026-02-12T10:58:08.005 INFO:teuthology.orchestra.run.trial069.stdout:(4/8): python3-pyparsing-2.4.7-9.el9.noarch.rpm 3.2 MB/s | 150 kB 00:00 2026-02-12T10:58:08.040 INFO:teuthology.orchestra.run.trial069.stdout:(5/8): nvme-cli-2.16-1.el9.x86_64.rpm 6.5 MB/s | 1.2 MB 00:00 2026-02-12T10:58:08.063 INFO:teuthology.orchestra.run.trial069.stdout:(6/8): libnvme-1.16.1-2.el9.x86_64.rpm 4.9 MB/s | 116 kB 00:00 2026-02-12T10:58:08.068 INFO:teuthology.orchestra.run.trial069.stdout:(7/8): python3-urwid-2.1.2-4.el9.x86_64.rpm 12 MB/s | 837 kB 00:00 2026-02-12T10:58:08.391 INFO:teuthology.orchestra.run.trial031.stdout:(1/8): nvmetcli-0.8-3.el9.noarch.rpm 138 kB/s | 44 kB 00:00 2026-02-12T10:58:08.437 INFO:teuthology.orchestra.run.trial031.stdout:(2/8): python3-configshell-1.1.30-1.el9.noarch. 198 kB/s | 72 kB 00:00 2026-02-12T10:58:08.495 INFO:teuthology.orchestra.run.trial069.stdout:(8/8): runc-1.4.0-1.el9.x86_64.rpm 8.1 MB/s | 4.0 MB 00:00 2026-02-12T10:58:08.496 INFO:teuthology.orchestra.run.trial069.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:58:08.496 INFO:teuthology.orchestra.run.trial069.stdout:Total 8.2 MB/s | 6.4 MB 00:00 2026-02-12T10:58:08.566 INFO:teuthology.orchestra.run.trial031.stdout:(3/8): python3-kmod-0.9-32.el9.x86_64.rpm 483 kB/s | 84 kB 00:00 2026-02-12T10:58:08.572 INFO:teuthology.orchestra.run.trial069.stdout:Running transaction check 2026-02-12T10:58:08.580 INFO:teuthology.orchestra.run.trial069.stdout:Transaction check succeeded. 2026-02-12T10:58:08.581 INFO:teuthology.orchestra.run.trial069.stdout:Running transaction test 2026-02-12T10:58:08.644 INFO:teuthology.orchestra.run.trial031.stdout:(4/8): python3-pyparsing-2.4.7-9.el9.noarch.rpm 727 kB/s | 150 kB 00:00 2026-02-12T10:58:08.659 INFO:teuthology.orchestra.run.trial069.stdout:Transaction test succeeded. 2026-02-12T10:58:08.659 INFO:teuthology.orchestra.run.trial069.stdout:Running transaction 2026-02-12T10:58:08.720 INFO:teuthology.orchestra.run.trial031.stdout:(5/8): runc-1.4.0-1.el9.x86_64.rpm 52 MB/s | 4.0 MB 00:00 2026-02-12T10:58:08.748 INFO:teuthology.orchestra.run.trial069.stdout: Preparing : 1/1 2026-02-12T10:58:08.758 INFO:teuthology.orchestra.run.trial031.stdout:(6/8): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-12T10:58:08.814 INFO:teuthology.orchestra.run.trial069.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/9 2026-02-12T10:58:08.821 INFO:teuthology.orchestra.run.trial069.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/9 2026-02-12T10:58:08.830 INFO:teuthology.orchestra.run.trial069.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/9 2026-02-12T10:58:08.832 INFO:teuthology.orchestra.run.trial031.stdout:(7/8): libnvme-1.16.1-2.el9.x86_64.rpm 1.0 MB/s | 116 kB 00:00 2026-02-12T10:58:08.836 INFO:teuthology.orchestra.run.trial069.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/9 2026-02-12T10:58:08.841 INFO:teuthology.orchestra.run.trial069.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/9 2026-02-12T10:58:08.842 INFO:teuthology.orchestra.run.trial069.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/9 2026-02-12T10:58:08.888 INFO:teuthology.orchestra.run.trial031.stdout:(8/8): python3-urwid-2.1.2-4.el9.x86_64.rpm 2.5 MB/s | 837 kB 00:00 2026-02-12T10:58:08.889 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:58:08.889 INFO:teuthology.orchestra.run.trial031.stdout:Total 5.4 MB/s | 6.4 MB 00:01 2026-02-12T10:58:08.966 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-12T10:58:08.969 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/9 2026-02-12T10:58:08.971 INFO:teuthology.orchestra.run.trial069.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/9 2026-02-12T10:58:08.974 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-12T10:58:08.974 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-12T10:58:09.051 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-12T10:58:09.051 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-12T10:58:09.135 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-12T10:58:09.203 INFO:teuthology.orchestra.run.trial031.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/9 2026-02-12T10:58:09.210 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/9 2026-02-12T10:58:09.219 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/9 2026-02-12T10:58:09.225 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/9 2026-02-12T10:58:09.230 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/9 2026-02-12T10:58:09.231 INFO:teuthology.orchestra.run.trial031.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/9 2026-02-12T10:58:09.256 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/9 2026-02-12T10:58:09.256 INFO:teuthology.orchestra.run.trial069.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T10:58:09.256 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:58:09.298 INFO:teuthology.orchestra.run.trial069.stdout: Installing : runc-4:1.4.0-1.el9.x86_64 8/9 2026-02-12T10:58:09.313 INFO:teuthology.orchestra.run.trial069.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 9/9 2026-02-12T10:58:09.361 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/9 2026-02-12T10:58:09.363 INFO:teuthology.orchestra.run.trial031.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 9/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : runc-4:1.4.0-1.el9.x86_64 7/9 2026-02-12T10:58:09.545 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 8/9 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: Verifying : libnvme-1.13-1.el9.x86_64 9/9 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout:Upgraded: 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout:Installed: 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: runc-4:1.4.0-1.el9.x86_64 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:58:09.599 INFO:teuthology.orchestra.run.trial069.stdout:Complete! 2026-02-12T10:58:09.639 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/9 2026-02-12T10:58:09.639 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T10:58:09.639 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:09.653 DEBUG:teuthology.parallel:result is None 2026-02-12T10:58:09.676 INFO:teuthology.orchestra.run.trial031.stdout: Installing : runc-4:1.4.0-1.el9.x86_64 8/9 2026-02-12T10:58:09.692 INFO:teuthology.orchestra.run.trial031.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 9/9 2026-02-12T10:58:09.910 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 9/9 2026-02-12T10:58:09.910 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/9 2026-02-12T10:58:09.910 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/9 2026-02-12T10:58:09.910 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/9 2026-02-12T10:58:09.910 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/9 2026-02-12T10:58:09.911 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/9 2026-02-12T10:58:09.911 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/9 2026-02-12T10:58:09.911 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : runc-4:1.4.0-1.el9.x86_64 7/9 2026-02-12T10:58:09.911 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 8/9 2026-02-12T10:58:09.964 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libnvme-1.13-1.el9.x86_64 9/9 2026-02-12T10:58:09.964 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:09.964 INFO:teuthology.orchestra.run.trial031.stdout:Upgraded: 2026-02-12T10:58:09.964 INFO:teuthology.orchestra.run.trial031.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-12T10:58:09.964 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-12T10:58:09.965 INFO:teuthology.orchestra.run.trial031.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-12T10:58:09.965 INFO:teuthology.orchestra.run.trial031.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-12T10:58:09.965 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-12T10:58:09.965 INFO:teuthology.orchestra.run.trial031.stdout: runc-4:1.4.0-1.el9.x86_64 2026-02-12T10:58:09.965 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:09.965 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-12T10:58:10.019 DEBUG:teuthology.parallel:result is None 2026-02-12T10:58:10.019 INFO:teuthology.run_tasks:Running task nvme_loop... 2026-02-12T10:58:10.039 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices... 2026-02-12T10:58:10.039 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:10.039 DEBUG:teuthology.orchestra.run.trial031:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:58:10.057 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T10:58:10.057 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_1 2026-02-12T10:58:10.112 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T10:58:10.112 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:10.113 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-12T10:58:10.113 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:10.113 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:10.113 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:09.822426789 +0000 2026-02-12T10:58:10.113 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.113 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.113 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.113 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T10:58:10.176 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:58:10.176 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:58:10.177 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000172932 s, 3.0 MB/s 2026-02-12T10:58:10.178 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T10:58:10.235 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_2 2026-02-12T10:58:10.291 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T10:58:10.291 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:10.291 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-12T10:58:10.291 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:10.291 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:10.292 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:09.822426789 +0000 2026-02-12T10:58:10.292 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.292 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.292 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.292 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T10:58:10.354 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:58:10.354 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:58:10.354 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000146693 s, 3.5 MB/s 2026-02-12T10:58:10.355 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T10:58:10.414 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_3 2026-02-12T10:58:10.470 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T10:58:10.470 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:10.470 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-12T10:58:10.470 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:10.470 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:10.471 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:09.822426789 +0000 2026-02-12T10:58:10.471 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.471 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.471 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.471 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T10:58:10.535 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:58:10.535 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:58:10.535 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000142926 s, 3.6 MB/s 2026-02-12T10:58:10.536 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T10:58:10.593 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_4 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:09.823426772 +0000 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.649 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:09.667429458 +0000 2026-02-12T10:58:10.649 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T10:58:10.713 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:58:10.713 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:58:10.714 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000130783 s, 3.9 MB/s 2026-02-12T10:58:10.714 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T10:58:10.770 DEBUG:teuthology.orchestra.run.trial031:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2026-02-12T10:58:10.876 INFO:teuthology.orchestra.run.trial031.stdout:loop 2026-02-12T10:58:10.877 INFO:tasks.nvme_loop:Connecting nvme_loop trial031:/dev/vg_nvme/lv_1... 2026-02-12T10:58:10.878 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2026-02-12T10:58:10.910 INFO:teuthology.orchestra.run.trial031.stdout:1 2026-02-12T10:58:10.939 INFO:teuthology.orchestra.run.trial031.stdout:/dev/vg_nvme/lv_11 2026-02-12T10:58:10.968 INFO:teuthology.orchestra.run.trial031.stdout:connecting to device: nvme3 2026-02-12T10:58:10.970 INFO:tasks.nvme_loop:Connecting nvme_loop trial031:/dev/vg_nvme/lv_2... 2026-02-12T10:58:10.971 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2026-02-12T10:58:11.048 INFO:teuthology.orchestra.run.trial031.stdout:1 2026-02-12T10:58:11.073 INFO:teuthology.orchestra.run.trial031.stdout:/dev/vg_nvme/lv_21 2026-02-12T10:58:11.107 INFO:teuthology.orchestra.run.trial031.stdout:connecting to device: nvme4 2026-02-12T10:58:11.108 INFO:tasks.nvme_loop:Connecting nvme_loop trial031:/dev/vg_nvme/lv_3... 2026-02-12T10:58:11.108 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2026-02-12T10:58:11.181 INFO:teuthology.orchestra.run.trial031.stdout:1 2026-02-12T10:58:11.207 INFO:teuthology.orchestra.run.trial031.stdout:/dev/vg_nvme/lv_31 2026-02-12T10:58:11.241 INFO:teuthology.orchestra.run.trial031.stdout:connecting to device: nvme5 2026-02-12T10:58:11.242 INFO:tasks.nvme_loop:Connecting nvme_loop trial031:/dev/vg_nvme/lv_4... 2026-02-12T10:58:11.243 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2026-02-12T10:58:11.314 INFO:teuthology.orchestra.run.trial031.stdout:1 2026-02-12T10:58:11.340 INFO:teuthology.orchestra.run.trial031.stdout:/dev/vg_nvme/lv_41 2026-02-12T10:58:11.369 INFO:teuthology.orchestra.run.trial031.stdout:connecting to device: nvme6 2026-02-12T10:58:11.370 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:11.371 DEBUG:teuthology.orchestra.run.trial031:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:58:11.427 DEBUG:teuthology.orchestra.run.trial031:> lsblk 2026-02-12T10:58:11.485 INFO:teuthology.orchestra.run.trial031.stdout:NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS 2026-02-12T10:58:11.485 INFO:teuthology.orchestra.run.trial031.stdout:nvme1n1 259:0 0 1.7T 0 disk 2026-02-12T10:58:11.485 INFO:teuthology.orchestra.run.trial031.stdout:├─vg_nvme-lv_1 253:0 0 700G 0 lvm 2026-02-12T10:58:11.485 INFO:teuthology.orchestra.run.trial031.stdout:├─vg_nvme-lv_2 253:1 0 700G 0 lvm 2026-02-12T10:58:11.485 INFO:teuthology.orchestra.run.trial031.stdout:└─vg_nvme-lv_5 253:4 0 100G 0 lvm /var/lib/ceph 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:nvme0n1 259:1 0 894.3G 0 disk 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:├─nvme0n1p1 259:3 0 512M 0 part /boot/efi 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:└─nvme0n1p2 259:4 0 893.8G 0 part / 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:nvme2n1 259:2 0 1.7T 0 disk 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:├─vg_nvme-lv_3 253:2 0 700G 0 lvm 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:└─vg_nvme-lv_4 253:3 0 700G 0 lvm 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:nvme3n1 259:6 0 700G 0 disk 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:nvme4n1 259:8 0 700G 0 disk 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:nvme5n1 259:10 0 700G 0 disk 2026-02-12T10:58:11.486 INFO:teuthology.orchestra.run.trial031.stdout:nvme6n1 259:12 0 700G 0 disk 2026-02-12T10:58:11.487 DEBUG:teuthology.orchestra.run.trial031:> sudo nvme list -o json 2026-02-12T10:58:11.552 INFO:teuthology.orchestra.run.trial031.stdout:{ 2026-02-12T10:58:11.552 INFO:teuthology.orchestra.run.trial031.stdout: "Devices":[ 2026-02-12T10:58:11.552 INFO:teuthology.orchestra.run.trial031.stdout: { 2026-02-12T10:58:11.552 INFO:teuthology.orchestra.run.trial031.stdout: "NameSpace":1, 2026-02-12T10:58:11.552 INFO:teuthology.orchestra.run.trial031.stdout: "DevicePath":"/dev/nvme0n1", 2026-02-12T10:58:11.552 INFO:teuthology.orchestra.run.trial031.stdout: "GenericPath":"/dev/ng0n1", 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "Firmware":"E2MU200", 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "SerialNumber":"25174FCD6BC1", 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "UsedBytes":589176586240, 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "MaximumLBA":1875385008, 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "PhysicalSize":960197124096, 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "SectorSize":512 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: }, 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: { 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "NameSpace":1, 2026-02-12T10:58:11.553 INFO:teuthology.orchestra.run.trial031.stdout: "DevicePath":"/dev/nvme1n1", 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "GenericPath":"/dev/ng1n1", 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "Firmware":"E3MQ000", 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "SerialNumber":"112510AB5195", 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "UsedBytes":8445808640, 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "MaximumLBA":3750748848, 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "PhysicalSize":1920383410176, 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "SectorSize":512 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: }, 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: { 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "NameSpace":1, 2026-02-12T10:58:11.554 INFO:teuthology.orchestra.run.trial031.stdout: "DevicePath":"/dev/nvme2n1", 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "GenericPath":"/dev/ng2n1", 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "Firmware":"E3MQ000", 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "SerialNumber":"112510AB516F", 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "UsedBytes":145634672640, 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "MaximumLBA":3750748848, 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "PhysicalSize":1920383410176, 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "SectorSize":512 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: }, 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: { 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "NameSpace":1, 2026-02-12T10:58:11.555 INFO:teuthology.orchestra.run.trial031.stdout: "DevicePath":"/dev/nvme3n1", 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "GenericPath":"/dev/ng3n1", 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "SerialNumber":"1db8ee2ede80f7558983", 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "SectorSize":512 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: }, 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: { 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "NameSpace":1, 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "DevicePath":"/dev/nvme4n1", 2026-02-12T10:58:11.556 INFO:teuthology.orchestra.run.trial031.stdout: "GenericPath":"/dev/ng4n1", 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "SerialNumber":"0c512f06da0d2341fc64", 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "SectorSize":512 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: }, 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: { 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "NameSpace":1, 2026-02-12T10:58:11.557 INFO:teuthology.orchestra.run.trial031.stdout: "DevicePath":"/dev/nvme5n1", 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "GenericPath":"/dev/ng5n1", 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "SerialNumber":"2625cf15164416c7779e", 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "SectorSize":512 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: }, 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: { 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "NameSpace":1, 2026-02-12T10:58:11.558 INFO:teuthology.orchestra.run.trial031.stdout: "DevicePath":"/dev/nvme6n1", 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "GenericPath":"/dev/ng6n1", 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "SerialNumber":"f7a57b9dcb1a714196ff", 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: "SectorSize":512 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: } 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout: ] 2026-02-12T10:58:11.559 INFO:teuthology.orchestra.run.trial031.stdout:} 2026-02-12T10:58:11.561 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=0 bs=1 count=4096 2026-02-12T10:58:11.628 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:11.629 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:11.629 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00429053 s, 955 kB/s 2026-02-12T10:58:11.630 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s0 /dev/nvme3n1 2026-02-12T10:58:11.692 INFO:teuthology.orchestra.run.trial031.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:11.692 INFO:teuthology.orchestra.run.trial031.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:11.693 INFO:teuthology.orchestra.run.trial031.stdout:00000016 2026-02-12T10:58:11.694 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:11.763 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:11.763 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:11.763 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00437659 s, 936 kB/s 2026-02-12T10:58:11.764 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s1073741824 /dev/nvme3n1 2026-02-12T10:58:11.827 INFO:teuthology.orchestra.run.trial031.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:11.827 INFO:teuthology.orchestra.run.trial031.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:11.828 INFO:teuthology.orchestra.run.trial031.stdout:40000016 2026-02-12T10:58:11.829 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:11.898 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:11.898 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:11.898 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0049348 s, 830 kB/s 2026-02-12T10:58:11.899 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s10737418240 /dev/nvme3n1 2026-02-12T10:58:11.962 INFO:teuthology.orchestra.run.trial031.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:11.962 INFO:teuthology.orchestra.run.trial031.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:11.962 INFO:teuthology.orchestra.run.trial031.stdout:280000016 2026-02-12T10:58:11.963 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=0 bs=1 count=4096 2026-02-12T10:58:12.029 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.030 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.030 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00441762 s, 927 kB/s 2026-02-12T10:58:12.031 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s0 /dev/nvme4n1 2026-02-12T10:58:12.094 INFO:teuthology.orchestra.run.trial031.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:12.094 INFO:teuthology.orchestra.run.trial031.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:12.095 INFO:teuthology.orchestra.run.trial031.stdout:00000016 2026-02-12T10:58:12.096 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:12.163 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.164 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.164 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00448637 s, 913 kB/s 2026-02-12T10:58:12.165 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s1073741824 /dev/nvme4n1 2026-02-12T10:58:12.227 INFO:teuthology.orchestra.run.trial031.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:12.227 INFO:teuthology.orchestra.run.trial031.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:12.227 INFO:teuthology.orchestra.run.trial031.stdout:40000016 2026-02-12T10:58:12.228 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:12.296 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.296 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.297 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00446443 s, 917 kB/s 2026-02-12T10:58:12.298 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s10737418240 /dev/nvme4n1 2026-02-12T10:58:12.360 INFO:teuthology.orchestra.run.trial031.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:12.361 INFO:teuthology.orchestra.run.trial031.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:12.361 INFO:teuthology.orchestra.run.trial031.stdout:280000016 2026-02-12T10:58:12.363 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=0 bs=1 count=4096 2026-02-12T10:58:12.429 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.429 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.430 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00485586 s, 844 kB/s 2026-02-12T10:58:12.431 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s0 /dev/nvme5n1 2026-02-12T10:58:12.494 INFO:teuthology.orchestra.run.trial031.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:12.494 INFO:teuthology.orchestra.run.trial031.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:12.494 INFO:teuthology.orchestra.run.trial031.stdout:00000016 2026-02-12T10:58:12.495 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:12.562 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.563 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.563 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00478528 s, 856 kB/s 2026-02-12T10:58:12.565 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s1073741824 /dev/nvme5n1 2026-02-12T10:58:12.627 INFO:teuthology.orchestra.run.trial031.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:12.628 INFO:teuthology.orchestra.run.trial031.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:12.628 INFO:teuthology.orchestra.run.trial031.stdout:40000016 2026-02-12T10:58:12.630 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:12.696 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.697 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.697 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.004731 s, 866 kB/s 2026-02-12T10:58:12.698 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s10737418240 /dev/nvme5n1 2026-02-12T10:58:12.760 INFO:teuthology.orchestra.run.trial031.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:12.760 INFO:teuthology.orchestra.run.trial031.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:12.760 INFO:teuthology.orchestra.run.trial031.stdout:280000016 2026-02-12T10:58:12.762 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=0 bs=1 count=4096 2026-02-12T10:58:12.827 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.828 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.828 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00431081 s, 950 kB/s 2026-02-12T10:58:12.829 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s0 /dev/nvme6n1 2026-02-12T10:58:12.900 INFO:teuthology.orchestra.run.trial031.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:12.901 INFO:teuthology.orchestra.run.trial031.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:12.901 INFO:teuthology.orchestra.run.trial031.stdout:00000016 2026-02-12T10:58:12.902 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:12.975 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:12.975 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:12.975 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00436389 s, 939 kB/s 2026-02-12T10:58:12.976 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s1073741824 /dev/nvme6n1 2026-02-12T10:58:13.039 INFO:teuthology.orchestra.run.trial031.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:13.039 INFO:teuthology.orchestra.run.trial031.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:13.039 INFO:teuthology.orchestra.run.trial031.stdout:40000016 2026-02-12T10:58:13.040 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:13.107 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records in 2026-02-12T10:58:13.107 INFO:teuthology.orchestra.run.trial031.stderr:4096+0 records out 2026-02-12T10:58:13.107 INFO:teuthology.orchestra.run.trial031.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00435046 s, 942 kB/s 2026-02-12T10:58:13.108 DEBUG:teuthology.orchestra.run.trial031:> sudo hexdump -n22 -C -s10737418240 /dev/nvme6n1 2026-02-12T10:58:13.169 INFO:teuthology.orchestra.run.trial031.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:13.169 INFO:teuthology.orchestra.run.trial031.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:13.170 INFO:teuthology.orchestra.run.trial031.stdout:280000016 2026-02-12T10:58:13.171 INFO:tasks.nvme_loop:new_devs ['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-12T10:58:13.171 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:13.171 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/scratch_devs 2026-02-12T10:58:13.237 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:58:13.237 DEBUG:teuthology.orchestra.run.trial069:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:58:13.257 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T10:58:13.257 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/vg_nvme/lv_1 2026-02-12T10:58:13.312 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:58:09.454008520 +0000 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.313 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.314 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T10:58:13.377 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:58:13.377 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:58:13.377 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000169256 s, 3.0 MB/s 2026-02-12T10:58:13.379 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T10:58:13.436 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/vg_nvme/lv_2 2026-02-12T10:58:13.491 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:58:09.454008520 +0000 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.492 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.493 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T10:58:13.555 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:58:13.556 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:58:13.556 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000144323 s, 3.5 MB/s 2026-02-12T10:58:13.557 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T10:58:13.614 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/vg_nvme/lv_3 2026-02-12T10:58:13.669 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T10:58:13.669 INFO:teuthology.orchestra.run.trial069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:13.670 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-12T10:58:13.670 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:13.670 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:13.670 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:58:09.455008502 +0000 2026-02-12T10:58:13.670 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.670 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.670 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:09.283011413 +0000 2026-02-12T10:58:13.670 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T10:58:13.732 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:58:13.732 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:58:13.732 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000146297 s, 3.5 MB/s 2026-02-12T10:58:13.733 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T10:58:13.792 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/vg_nvme/lv_4 2026-02-12T10:58:13.847 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T10:58:13.847 INFO:teuthology.orchestra.run.trial069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:58:13.848 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-12T10:58:13.848 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:58:13.848 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:58:13.848 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:58:09.455008502 +0000 2026-02-12T10:58:13.848 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:09.282011429 +0000 2026-02-12T10:58:13.848 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:09.282011429 +0000 2026-02-12T10:58:13.848 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:09.282011429 +0000 2026-02-12T10:58:13.849 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T10:58:13.909 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:58:13.910 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:58:13.910 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000140807 s, 3.6 MB/s 2026-02-12T10:58:13.911 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T10:58:13.968 DEBUG:teuthology.orchestra.run.trial069:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2026-02-12T10:58:14.073 INFO:teuthology.orchestra.run.trial069.stdout:loop 2026-02-12T10:58:14.075 INFO:tasks.nvme_loop:Connecting nvme_loop trial069:/dev/vg_nvme/lv_1... 2026-02-12T10:58:14.075 DEBUG:teuthology.orchestra.run.trial069:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2026-02-12T10:58:14.107 INFO:teuthology.orchestra.run.trial069.stdout:1 2026-02-12T10:58:14.132 INFO:teuthology.orchestra.run.trial069.stdout:/dev/vg_nvme/lv_11 2026-02-12T10:58:14.166 INFO:teuthology.orchestra.run.trial069.stdout:connecting to device: nvme3 2026-02-12T10:58:14.168 INFO:tasks.nvme_loop:Connecting nvme_loop trial069:/dev/vg_nvme/lv_2... 2026-02-12T10:58:14.168 DEBUG:teuthology.orchestra.run.trial069:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2026-02-12T10:58:14.242 INFO:teuthology.orchestra.run.trial069.stdout:1 2026-02-12T10:58:14.267 INFO:teuthology.orchestra.run.trial069.stdout:/dev/vg_nvme/lv_21 2026-02-12T10:58:14.296 INFO:teuthology.orchestra.run.trial069.stdout:connecting to device: nvme4 2026-02-12T10:58:14.298 INFO:tasks.nvme_loop:Connecting nvme_loop trial069:/dev/vg_nvme/lv_3... 2026-02-12T10:58:14.298 DEBUG:teuthology.orchestra.run.trial069:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2026-02-12T10:58:14.369 INFO:teuthology.orchestra.run.trial069.stdout:1 2026-02-12T10:58:14.394 INFO:teuthology.orchestra.run.trial069.stdout:/dev/vg_nvme/lv_31 2026-02-12T10:58:14.422 INFO:teuthology.orchestra.run.trial069.stdout:connecting to device: nvme5 2026-02-12T10:58:14.424 INFO:tasks.nvme_loop:Connecting nvme_loop trial069:/dev/vg_nvme/lv_4... 2026-02-12T10:58:14.424 DEBUG:teuthology.orchestra.run.trial069:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2026-02-12T10:58:14.496 INFO:teuthology.orchestra.run.trial069.stdout:1 2026-02-12T10:58:14.521 INFO:teuthology.orchestra.run.trial069.stdout:/dev/vg_nvme/lv_41 2026-02-12T10:58:14.555 INFO:teuthology.orchestra.run.trial069.stdout:connecting to device: nvme6 2026-02-12T10:58:14.557 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:58:14.557 DEBUG:teuthology.orchestra.run.trial069:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:58:14.614 DEBUG:teuthology.orchestra.run.trial069:> lsblk 2026-02-12T10:58:14.673 INFO:teuthology.orchestra.run.trial069.stdout:NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS 2026-02-12T10:58:14.673 INFO:teuthology.orchestra.run.trial069.stdout:nvme0n1 259:0 0 1.7T 0 disk 2026-02-12T10:58:14.673 INFO:teuthology.orchestra.run.trial069.stdout:├─vg_nvme-lv_1 253:0 0 700G 0 lvm 2026-02-12T10:58:14.673 INFO:teuthology.orchestra.run.trial069.stdout:├─vg_nvme-lv_2 253:1 0 700G 0 lvm 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:└─vg_nvme-lv_5 253:4 0 100G 0 lvm /var/lib/ceph 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:nvme1n1 259:1 0 1.7T 0 disk 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:├─vg_nvme-lv_3 253:2 0 700G 0 lvm 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:└─vg_nvme-lv_4 253:3 0 700G 0 lvm 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:nvme2n1 259:2 0 894.3G 0 disk 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:├─nvme2n1p1 259:3 0 512M 0 part /boot/efi 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:└─nvme2n1p2 259:4 0 893.8G 0 part / 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:nvme3n1 259:6 0 700G 0 disk 2026-02-12T10:58:14.674 INFO:teuthology.orchestra.run.trial069.stdout:nvme4n1 259:8 0 700G 0 disk 2026-02-12T10:58:14.675 INFO:teuthology.orchestra.run.trial069.stdout:nvme5n1 259:10 0 700G 0 disk 2026-02-12T10:58:14.675 INFO:teuthology.orchestra.run.trial069.stdout:nvme6n1 259:12 0 700G 0 disk 2026-02-12T10:58:14.675 DEBUG:teuthology.orchestra.run.trial069:> sudo nvme list -o json 2026-02-12T10:58:14.746 INFO:teuthology.orchestra.run.trial069.stdout:{ 2026-02-12T10:58:14.746 INFO:teuthology.orchestra.run.trial069.stdout: "Devices":[ 2026-02-12T10:58:14.746 INFO:teuthology.orchestra.run.trial069.stdout: { 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "NameSpace":1, 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "DevicePath":"/dev/nvme0n1", 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "GenericPath":"/dev/ng0n1", 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "Firmware":"E3MQ000", 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "SerialNumber":"012510B00426", 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "UsedBytes":142046613504, 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "MaximumLBA":3750748848, 2026-02-12T10:58:14.747 INFO:teuthology.orchestra.run.trial069.stdout: "PhysicalSize":1920383410176, 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "SectorSize":512 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: }, 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: { 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "NameSpace":1, 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "DevicePath":"/dev/nvme1n1", 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "GenericPath":"/dev/ng1n1", 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "Firmware":"E3MQ000", 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "ModelNumber":"MTFDKCC1T9TGP-1BK1JABYY", 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "SerialNumber":"012510B00440", 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "UsedBytes":142445162496, 2026-02-12T10:58:14.748 INFO:teuthology.orchestra.run.trial069.stdout: "MaximumLBA":3750748848, 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "PhysicalSize":1920383410176, 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "SectorSize":512 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: }, 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: { 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "NameSpace":1, 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "DevicePath":"/dev/nvme2n1", 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "GenericPath":"/dev/ng2n1", 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "Firmware":"E2MU200", 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "ModelNumber":"Micron_7450_MTFDKBA960TFR", 2026-02-12T10:58:14.749 INFO:teuthology.orchestra.run.trial069.stdout: "SerialNumber":"25174FCD463C", 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "UsedBytes":132277202944, 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "MaximumLBA":1875385008, 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "PhysicalSize":960197124096, 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "SectorSize":512 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: }, 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: { 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "NameSpace":1, 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "DevicePath":"/dev/nvme3n1", 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "GenericPath":"/dev/ng3n1", 2026-02-12T10:58:14.750 INFO:teuthology.orchestra.run.trial069.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "SerialNumber":"9c68a612098e2f89cc0d", 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "SectorSize":512 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: }, 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: { 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "NameSpace":1, 2026-02-12T10:58:14.751 INFO:teuthology.orchestra.run.trial069.stdout: "DevicePath":"/dev/nvme4n1", 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "GenericPath":"/dev/ng4n1", 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "SerialNumber":"5cd7e615781dd0ced459", 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "SectorSize":512 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: }, 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: { 2026-02-12T10:58:14.752 INFO:teuthology.orchestra.run.trial069.stdout: "NameSpace":1, 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "DevicePath":"/dev/nvme5n1", 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "GenericPath":"/dev/ng5n1", 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "SerialNumber":"2afc4f58391b1c7b232e", 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:14.753 INFO:teuthology.orchestra.run.trial069.stdout: "SectorSize":512 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: }, 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: { 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "NameSpace":1, 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "DevicePath":"/dev/nvme6n1", 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "GenericPath":"/dev/ng6n1", 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "Firmware":"5.14.0-6", 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "ModelNumber":"Linux", 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "SerialNumber":"6eece110976ab60a8a9e", 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "UsedBytes":751619276800, 2026-02-12T10:58:14.754 INFO:teuthology.orchestra.run.trial069.stdout: "MaximumLBA":1468006400, 2026-02-12T10:58:14.755 INFO:teuthology.orchestra.run.trial069.stdout: "PhysicalSize":751619276800, 2026-02-12T10:58:14.755 INFO:teuthology.orchestra.run.trial069.stdout: "SectorSize":512 2026-02-12T10:58:14.755 INFO:teuthology.orchestra.run.trial069.stdout: } 2026-02-12T10:58:14.755 INFO:teuthology.orchestra.run.trial069.stdout: ] 2026-02-12T10:58:14.755 INFO:teuthology.orchestra.run.trial069.stdout:} 2026-02-12T10:58:14.757 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=0 bs=1 count=4096 2026-02-12T10:58:14.832 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:14.832 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:14.832 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00452086 s, 906 kB/s 2026-02-12T10:58:14.833 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s0 /dev/nvme3n1 2026-02-12T10:58:14.896 INFO:teuthology.orchestra.run.trial069.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:14.896 INFO:teuthology.orchestra.run.trial069.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:14.896 INFO:teuthology.orchestra.run.trial069.stdout:00000016 2026-02-12T10:58:14.897 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:14.964 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:14.964 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:14.965 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00485633 s, 843 kB/s 2026-02-12T10:58:14.966 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s1073741824 /dev/nvme3n1 2026-02-12T10:58:15.030 INFO:teuthology.orchestra.run.trial069.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.030 INFO:teuthology.orchestra.run.trial069.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.031 INFO:teuthology.orchestra.run.trial069.stdout:40000016 2026-02-12T10:58:15.032 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme3n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:15.099 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:15.099 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:15.099 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00436586 s, 938 kB/s 2026-02-12T10:58:15.101 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s10737418240 /dev/nvme3n1 2026-02-12T10:58:15.165 INFO:teuthology.orchestra.run.trial069.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.165 INFO:teuthology.orchestra.run.trial069.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.166 INFO:teuthology.orchestra.run.trial069.stdout:280000016 2026-02-12T10:58:15.167 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=0 bs=1 count=4096 2026-02-12T10:58:15.236 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:15.236 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:15.236 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00493159 s, 831 kB/s 2026-02-12T10:58:15.238 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s0 /dev/nvme4n1 2026-02-12T10:58:15.300 INFO:teuthology.orchestra.run.trial069.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.300 INFO:teuthology.orchestra.run.trial069.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.300 INFO:teuthology.orchestra.run.trial069.stdout:00000016 2026-02-12T10:58:15.302 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:15.369 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:15.369 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:15.369 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00517282 s, 792 kB/s 2026-02-12T10:58:15.370 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s1073741824 /dev/nvme4n1 2026-02-12T10:58:15.431 INFO:teuthology.orchestra.run.trial069.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.432 INFO:teuthology.orchestra.run.trial069.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.432 INFO:teuthology.orchestra.run.trial069.stdout:40000016 2026-02-12T10:58:15.433 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme4n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:15.500 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:15.500 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:15.500 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00476352 s, 860 kB/s 2026-02-12T10:58:15.502 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s10737418240 /dev/nvme4n1 2026-02-12T10:58:15.564 INFO:teuthology.orchestra.run.trial069.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.564 INFO:teuthology.orchestra.run.trial069.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.564 INFO:teuthology.orchestra.run.trial069.stdout:280000016 2026-02-12T10:58:15.566 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=0 bs=1 count=4096 2026-02-12T10:58:15.632 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:15.632 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:15.632 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00446097 s, 918 kB/s 2026-02-12T10:58:15.634 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s0 /dev/nvme5n1 2026-02-12T10:58:15.696 INFO:teuthology.orchestra.run.trial069.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.696 INFO:teuthology.orchestra.run.trial069.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.696 INFO:teuthology.orchestra.run.trial069.stdout:00000016 2026-02-12T10:58:15.697 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:15.764 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:15.764 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:15.764 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00433651 s, 945 kB/s 2026-02-12T10:58:15.765 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s1073741824 /dev/nvme5n1 2026-02-12T10:58:15.827 INFO:teuthology.orchestra.run.trial069.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.827 INFO:teuthology.orchestra.run.trial069.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.827 INFO:teuthology.orchestra.run.trial069.stdout:40000016 2026-02-12T10:58:15.828 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme5n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:15.896 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:15.896 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:15.896 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00498874 s, 821 kB/s 2026-02-12T10:58:15.898 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s10737418240 /dev/nvme5n1 2026-02-12T10:58:15.959 INFO:teuthology.orchestra.run.trial069.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:15.960 INFO:teuthology.orchestra.run.trial069.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:15.960 INFO:teuthology.orchestra.run.trial069.stdout:280000016 2026-02-12T10:58:15.961 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=0 bs=1 count=4096 2026-02-12T10:58:16.029 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:16.029 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:16.029 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00493633 s, 830 kB/s 2026-02-12T10:58:16.030 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s0 /dev/nvme6n1 2026-02-12T10:58:16.092 INFO:teuthology.orchestra.run.trial069.stdout:00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:16.093 INFO:teuthology.orchestra.run.trial069.stdout:00000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:16.093 INFO:teuthology.orchestra.run.trial069.stdout:00000016 2026-02-12T10:58:16.094 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=1073741824 bs=1 count=4096 2026-02-12T10:58:16.161 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:16.162 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:16.162 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00458147 s, 894 kB/s 2026-02-12T10:58:16.163 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s1073741824 /dev/nvme6n1 2026-02-12T10:58:16.225 INFO:teuthology.orchestra.run.trial069.stdout:40000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:16.226 INFO:teuthology.orchestra.run.trial069.stdout:40000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:16.226 INFO:teuthology.orchestra.run.trial069.stdout:40000016 2026-02-12T10:58:16.227 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/zero of=/dev/nvme6n1 seek=10737418240 bs=1 count=4096 2026-02-12T10:58:16.296 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records in 2026-02-12T10:58:16.296 INFO:teuthology.orchestra.run.trial069.stderr:4096+0 records out 2026-02-12T10:58:16.296 INFO:teuthology.orchestra.run.trial069.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00515882 s, 794 kB/s 2026-02-12T10:58:16.297 DEBUG:teuthology.orchestra.run.trial069:> sudo hexdump -n22 -C -s10737418240 /dev/nvme6n1 2026-02-12T10:58:16.360 INFO:teuthology.orchestra.run.trial069.stdout:280000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-12T10:58:16.360 INFO:teuthology.orchestra.run.trial069.stdout:280000010 00 00 00 00 00 00 |......| 2026-02-12T10:58:16.360 INFO:teuthology.orchestra.run.trial069.stdout:280000016 2026-02-12T10:58:16.361 INFO:tasks.nvme_loop:new_devs ['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-12T10:58:16.361 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:58:16.361 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/scratch_devs 2026-02-12T10:58:16.425 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-12T10:58:16.553 INFO:tasks.cephadm:Config: {'roleless': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'OSD_DOWN', 'CEPHADM_FAILED_DAEMON', 'but it is still running', 'PG_DEGRADED'], 'log-only-match': ['CEPHADM_'], 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'} 2026-02-12T10:58:16.553 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:58:16.555 INFO:tasks.cephadm:Cluster fsid is bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:16.555 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-12T10:58:16.555 INFO:tasks.cephadm:No mon roles; fabricating mons 2026-02-12T10:58:16.555 INFO:tasks.cephadm:Monitor IPs: {'mon.trial031': '10.20.193.31', 'mon.trial069': '10.20.193.69'} 2026-02-12T10:58:16.555 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-12T10:58:16.556 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname $(hostname -s) 2026-02-12T10:58:16.581 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname $(hostname -s) 2026-02-12T10:58:16.606 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-12T10:58:16.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:58:16.730 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'ref': 'wip-squid-pr-67199-kefu-1', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-08 09:09:39.435166', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-680-g05b55d19', 'package_manager_version': '19.2.3-680.g05b55d19', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2857/', 'root_build_cause': '', 'node_name': '10.20.192.93+toko03', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-12T10:58:16.844 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-squid-pr-67199-kefu-1, sha1 05b55d192f002ad5df41409624b8d176527d0841 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:58:16.846 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-12T10:58:16.846 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-12T10:58:16.846 DEBUG:teuthology.orchestra.run.trial031:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-12T10:58:17.110 INFO:teuthology.orchestra.run.trial031.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 12 10:58 /home/ubuntu/cephtest/cephadm 2026-02-12T10:58:17.110 DEBUG:teuthology.orchestra.run.trial069:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-12T10:58:17.389 INFO:teuthology.orchestra.run.trial069.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 12 10:58 /home/ubuntu/cephtest/cephadm 2026-02-12T10:58:17.390 DEBUG:teuthology.orchestra.run.trial031:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-12T10:58:17.406 DEBUG:teuthology.orchestra.run.trial069:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-12T10:58:17.437 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 on all hosts... 2026-02-12T10:58:17.438 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-12T10:58:17.448 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-12T10:58:17.591 INFO:teuthology.orchestra.run.trial031.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:58:17.616 INFO:teuthology.orchestra.run.trial069.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:58:25.756 INFO:teuthology.orchestra.run.trial069.stdout:{ 2026-02-12T10:58:25.756 INFO:teuthology.orchestra.run.trial069.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-12T10:58:25.757 INFO:teuthology.orchestra.run.trial069.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-12T10:58:25.757 INFO:teuthology.orchestra.run.trial069.stdout: "repo_digests": [ 2026-02-12T10:58:25.757 INFO:teuthology.orchestra.run.trial069.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-12T10:58:25.757 INFO:teuthology.orchestra.run.trial069.stdout: ] 2026-02-12T10:58:25.757 INFO:teuthology.orchestra.run.trial069.stdout:} 2026-02-12T10:58:25.804 INFO:teuthology.orchestra.run.trial031.stdout:{ 2026-02-12T10:58:25.804 INFO:teuthology.orchestra.run.trial031.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-12T10:58:25.804 INFO:teuthology.orchestra.run.trial031.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-12T10:58:25.804 INFO:teuthology.orchestra.run.trial031.stdout: "repo_digests": [ 2026-02-12T10:58:25.805 INFO:teuthology.orchestra.run.trial031.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-12T10:58:25.805 INFO:teuthology.orchestra.run.trial031.stdout: ] 2026-02-12T10:58:25.805 INFO:teuthology.orchestra.run.trial031.stdout:} 2026-02-12T10:58:25.820 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /etc/ceph 2026-02-12T10:58:25.875 DEBUG:teuthology.orchestra.run.trial069:> sudo mkdir -p /etc/ceph 2026-02-12T10:58:25.904 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod 777 /etc/ceph 2026-02-12T10:58:25.928 DEBUG:teuthology.orchestra.run.trial069:> sudo chmod 777 /etc/ceph 2026-02-12T10:58:25.969 INFO:tasks.cephadm:Writing seed config... 2026-02-12T10:58:25.971 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-12T10:58:25.971 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-12T10:58:25.971 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-12T10:58:25.971 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-12T10:58:25.972 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-12T10:58:25.972 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-12T10:58:25.972 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-12T10:58:25.972 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-12T10:58:25.973 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:25.973 DEBUG:teuthology.orchestra.run.trial031:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-12T10:58:25.989 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bbe50c82-0801-11f1-9f0b-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-12T10:58:25.989 DEBUG:teuthology.orchestra.run.trial031:mon.trial031> sudo journalctl -f -n 0 -u ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031.service 2026-02-12T10:58:26.031 INFO:tasks.cephadm:Bootstrapping... 2026-02-12T10:58:26.032 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 -v bootstrap --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 10.20.193.31 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:58:26.166 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:58:26.166 INFO:teuthology.orchestra.run.trial031.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841', '-v', 'bootstrap', '--fsid', 'bbe50c82-0801-11f1-9f0b-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '10.20.193.31', '--skip-admin-label'] 2026-02-12T10:58:26.167 INFO:teuthology.orchestra.run.trial031.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-12T10:58:26.167 INFO:teuthology.orchestra.run.trial031.stdout:Verifying podman|docker is present... 2026-02-12T10:58:26.181 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stdout 5.6.0 2026-02-12T10:58:26.181 INFO:teuthology.orchestra.run.trial031.stdout:Verifying lvm2 is present... 2026-02-12T10:58:26.181 INFO:teuthology.orchestra.run.trial031.stdout:Verifying time synchronization is in place... 2026-02-12T10:58:26.187 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-12T10:58:26.187 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-12T10:58:26.192 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-12T10:58:26.192 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout inactive 2026-02-12T10:58:26.198 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout enabled 2026-02-12T10:58:26.203 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout active 2026-02-12T10:58:26.203 INFO:teuthology.orchestra.run.trial031.stdout:Unit chronyd.service is enabled and running 2026-02-12T10:58:26.203 INFO:teuthology.orchestra.run.trial031.stdout:Repeating the final host check... 2026-02-12T10:58:26.217 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stdout 5.6.0 2026-02-12T10:58:26.217 INFO:teuthology.orchestra.run.trial031.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-12T10:58:26.218 INFO:teuthology.orchestra.run.trial031.stdout:systemctl is present 2026-02-12T10:58:26.218 INFO:teuthology.orchestra.run.trial031.stdout:lvcreate is present 2026-02-12T10:58:26.223 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-12T10:58:26.223 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-12T10:58:26.228 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-12T10:58:26.228 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout inactive 2026-02-12T10:58:26.234 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout enabled 2026-02-12T10:58:26.240 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout active 2026-02-12T10:58:26.240 INFO:teuthology.orchestra.run.trial031.stdout:Unit chronyd.service is enabled and running 2026-02-12T10:58:26.240 INFO:teuthology.orchestra.run.trial031.stdout:Host looks OK 2026-02-12T10:58:26.240 INFO:teuthology.orchestra.run.trial031.stdout:Cluster fsid: bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:26.241 INFO:teuthology.orchestra.run.trial031.stdout:Acquiring lock 139653598617856 on /run/cephadm/bbe50c82-0801-11f1-9f0b-d404e6e7d460.lock 2026-02-12T10:58:26.241 INFO:teuthology.orchestra.run.trial031.stdout:Lock 139653598617856 acquired on /run/cephadm/bbe50c82-0801-11f1-9f0b-d404e6e7d460.lock 2026-02-12T10:58:26.241 INFO:teuthology.orchestra.run.trial031.stdout:Verifying IP 10.20.193.31 port 3300 ... 2026-02-12T10:58:26.241 INFO:teuthology.orchestra.run.trial031.stdout:Verifying IP 10.20.193.31 port 6789 ... 2026-02-12T10:58:26.241 INFO:teuthology.orchestra.run.trial031.stdout:Base mon IP(s) is [10.20.193.31:3300, 10.20.193.31:6789], mon addrv is [v2:10.20.193.31:3300,v1:10.20.193.31:6789] 2026-02-12T10:58:26.244 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.31 metric 102 2026-02-12T10:58:26.244 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.31 metric 102 2026-02-12T10:58:26.244 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-12T10:58:26.246 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-12T10:58:26.246 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-12T10:58:26.247 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-12T10:58:26.249 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout inet6 fe80::2635:448b:bb3a:aadf/64 scope link noprefixroute 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6236/64 scope link 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:Mon IP `10.20.193.31` is in CIDR network `10.20.192.0/20` 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:Mon IP `10.20.193.31` is in CIDR network `10.20.192.0/20` 2026-02-12T10:58:26.250 INFO:teuthology.orchestra.run.trial031.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-12T10:58:26.251 INFO:teuthology.orchestra.run.trial031.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-12T10:58:26.251 INFO:teuthology.orchestra.run.trial031.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:58:26.493 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stdout dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-12T10:58:26.493 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:58:26.493 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stderr Getting image source signatures 2026-02-12T10:58:26.494 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stderr Copying blob sha256:a10ade7902ac0ef76ec881f51088d9f38168c6983473ae266a7fda42a3d99f76 2026-02-12T10:58:26.494 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stderr Copying blob sha256:c92ccfe8c151fb35c12ff15a7a7de08028e120d73814d436eadc192e84f49ad9 2026-02-12T10:58:26.494 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stderr Copying config sha256:dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-12T10:58:26.494 INFO:teuthology.orchestra.run.trial031.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-12T10:58:26.767 INFO:teuthology.orchestra.run.trial031.stdout:ceph: stdout ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-12T10:58:26.767 INFO:teuthology.orchestra.run.trial031.stdout:Ceph version: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-12T10:58:26.767 INFO:teuthology.orchestra.run.trial031.stdout:Extracting ceph user uid/gid from container image... 2026-02-12T10:58:27.039 INFO:teuthology.orchestra.run.trial031.stdout:stat: stdout 167 167 2026-02-12T10:58:27.040 INFO:teuthology.orchestra.run.trial031.stdout:Creating initial keys... 2026-02-12T10:58:27.300 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph-authtool: stdout AQBTso1plTnzChAABpUCWUbFR5FXVQU8N5dPZg== 2026-02-12T10:58:27.550 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph-authtool: stdout AQBTso1pn2jGGRAASUN6w2x/OC7F/Bk+hneilg== 2026-02-12T10:58:27.817 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph-authtool: stdout AQBTso1pulPDKRAAIojQASq0DIVsP9t9pjpUlA== 2026-02-12T10:58:27.818 INFO:teuthology.orchestra.run.trial031.stdout:Creating initial monmap... 2026-02-12T10:58:28.089 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-12T10:58:28.089 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-12T10:58:28.089 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:28.089 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-12T10:58:28.090 INFO:teuthology.orchestra.run.trial031.stdout:monmaptool for trial031 [v2:10.20.193.31:3300,v1:10.20.193.31:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-12T10:58:28.090 INFO:teuthology.orchestra.run.trial031.stdout:setting min_mon_release = quincy 2026-02-12T10:58:28.090 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/monmaptool: set fsid to bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:28.090 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-12T10:58:28.090 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:28.090 INFO:teuthology.orchestra.run.trial031.stdout:Creating mon... 2026-02-12T10:58:28.363 INFO:teuthology.orchestra.run.trial031.stdout:create mon.trial031 on 2026-02-12T10:58:28.627 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-12T10:58:28.748 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460.target → /etc/systemd/system/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460.target. 2026-02-12T10:58:28.748 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460.target → /etc/systemd/system/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460.target. 2026-02-12T10:58:28.881 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031 2026-02-12T10:58:28.881 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031.service: Unit ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031.service not loaded. 2026-02-12T10:58:29.005 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460.target.wants/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031.service → /etc/systemd/system/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@.service. 2026-02-12T10:58:29.137 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:29 trial031 podman[17196]: 2026-02-12 10:58:29.135855209 +0000 UTC m=+0.049983316 container init 6a2df974cddd5faba9b8205556d4026e7742b9a39129121247df6f2cbf7d9750 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-12T10:58:29.157 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:58:29.157 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout disabled 2026-02-12T10:58:29.163 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:58:29.163 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout inactive 2026-02-12T10:58:29.163 INFO:teuthology.orchestra.run.trial031.stdout:firewalld.service is not enabled 2026-02-12T10:58:29.163 INFO:teuthology.orchestra.run.trial031.stdout:Not possible to enable service . firewalld.service is not available 2026-02-12T10:58:29.164 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for mon to start... 2026-02-12T10:58:29.164 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for mon... 2026-02-12T10:58:29.438 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:29 trial031 podman[17196]: 2026-02-12 10:58:29.13936295 +0000 UTC m=+0.053491047 container start 6a2df974cddd5faba9b8205556d4026e7742b9a39129121247df6f2cbf7d9750 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, ceph=True, io.buildah.version=1.33.7, OSD_FLAVOR=default) 2026-02-12T10:58:29.438 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:29 trial031 bash[17196]: 6a2df974cddd5faba9b8205556d4026e7742b9a39129121247df6f2cbf7d9750 2026-02-12T10:58:29.438 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:29 trial031 podman[17196]: 2026-02-12 10:58:29.095095976 +0000 UTC m=+0.009224083 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:58:29.438 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:29 trial031 systemd[1]: Started Ceph mon.trial031 for bbe50c82-0801-11f1-9f0b-d404e6e7d460. 2026-02-12T10:58:29.438 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:29 trial031 ceph-mon[17247]: mkfs bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:29.438 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:29 trial031 ceph-mon[17247]: mon.trial031 is new leader, mons trial031 in quorum (ranks 0) 2026-02-12T10:58:29.441 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout cluster: 2026-02-12T10:58:29.441 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout id: bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout services: 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum trial031 (age 0.151033s) 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout data: 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-12T10:58:29.442 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-12T10:58:29.443 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout pgs: 2026-02-12T10:58:29.443 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:29.443 INFO:teuthology.orchestra.run.trial031.stdout:mon is available 2026-02-12T10:58:29.443 INFO:teuthology.orchestra.run.trial031.stdout:Assimilating anything we can from ceph.conf... 2026-02-12T10:58:29.717 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:29.717 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout [global] 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout fsid = bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.31:3300,v1:10.20.193.31:6789] 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:29.718 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout [osd] 2026-02-12T10:58:29.719 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-12T10:58:29.719 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-12T10:58:29.719 INFO:teuthology.orchestra.run.trial031.stdout:Generating new minimal ceph.conf... 2026-02-12T10:58:30.002 INFO:teuthology.orchestra.run.trial031.stdout:Restarting the monitor... 2026-02-12T10:58:30.306 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 systemd[1]: Stopping Ceph mon.trial031 for bbe50c82-0801-11f1-9f0b-d404e6e7d460... 2026-02-12T10:58:30.306 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031[17221]: 2026-02-12T10:58:30.081+0000 7fc1c40e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial031 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:58:30.307 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031[17221]: 2026-02-12T10:58:30.081+0000 7fc1c40e5640 -1 mon.trial031@0(leader) e1 *** Got Signal Terminated *** 2026-02-12T10:58:30.566 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 podman[17617]: 2026-02-12 10:58:30.305304623 +0000 UTC m=+0.235875098 container died 6a2df974cddd5faba9b8205556d4026e7742b9a39129121247df6f2cbf7d9750 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031, org.label-schema.build-date=20260202, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-12T10:58:30.567 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 podman[17617]: 2026-02-12 10:58:30.417524497 +0000 UTC m=+0.348094962 container remove 6a2df974cddd5faba9b8205556d4026e7742b9a39129121247df6f2cbf7d9750 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.vendor=CentOS) 2026-02-12T10:58:30.567 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 bash[17617]: ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031 2026-02-12T10:58:30.567 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 systemd[1]: ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031.service: Deactivated successfully. 2026-02-12T10:58:30.567 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 systemd[1]: Stopped Ceph mon.trial031 for bbe50c82-0801-11f1-9f0b-d404e6e7d460. 2026-02-12T10:58:30.567 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 systemd[1]: Starting Ceph mon.trial031 for bbe50c82-0801-11f1-9f0b-d404e6e7d460... 2026-02-12T10:58:30.605 INFO:teuthology.orchestra.run.trial031.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-12T10:58:30.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 podman[17760]: 2026-02-12 10:58:30.565710389 +0000 UTC m=+0.015509275 container create 07bc85666a443c449ebb7c3ee3920371821fef87bcebd1ad2d2a468f767ae72b (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.build-date=20260202, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.license=GPLv2, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841) 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 podman[17760]: 2026-02-12 10:58:30.596416726 +0000 UTC m=+0.046215622 container init 07bc85666a443c449ebb7c3ee3920371821fef87bcebd1ad2d2a468f767ae72b (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 podman[17760]: 2026-02-12 10:58:30.599886296 +0000 UTC m=+0.049685202 container start 07bc85666a443c449ebb7c3ee3920371821fef87bcebd1ad2d2a468f767ae72b (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default) 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 bash[17760]: 07bc85666a443c449ebb7c3ee3920371821fef87bcebd1ad2d2a468f767ae72b 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 podman[17760]: 2026-02-12 10:58:30.559240835 +0000 UTC m=+0.009039731 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 systemd[1]: Started Ceph mon.trial031 for bbe50c82-0801-11f1-9f0b-d404e6e7d460. 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: set uid:gid to 167:167 (ceph:ceph) 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable), process ceph-mon, pid 7 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: pidfile_write: ignore empty --pid-file 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: load: jerasure load: lrc 2026-02-12T10:58:30.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: RocksDB version: 7.9.2 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Git sha 0 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Compile date 2026-02-08 08:28:36 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: DB SUMMARY 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: DB Session ID: NUK7SJMDDOZGME5BNWOP 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: CURRENT file: CURRENT 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: IDENTITY file: IDENTITY 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: SST files in /var/lib/ceph/mon/ceph-trial031/store.db dir, Total Num: 1, files: 000008.sst 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-trial031/store.db: 000009.log size: 74651 ; 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.error_if_exists: 0 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.create_if_missing: 0 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.paranoid_checks: 1 2026-02-12T10:58:30.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.env: 0x55c4bd596dc0 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.fs: PosixFileSystem 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.info_log: 0x55c4be8efa20 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_file_opening_threads: 16 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.statistics: (nil) 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.use_fsync: 0 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_log_file_size: 0 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.keep_log_file_num: 1000 2026-02-12T10:58:30.885 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.recycle_log_file_num: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.allow_fallocate: 1 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.allow_mmap_reads: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.allow_mmap_writes: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.use_direct_reads: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.create_missing_column_families: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.db_log_dir: 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.wal_dir: 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-12T10:58:30.886 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.advise_random_on_open: 1 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.db_write_buffer_size: 0 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.write_buffer_manager: 0x55c4be8f3900 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.rate_limiter: (nil) 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.wal_recovery_mode: 2 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.enable_thread_tracking: 0 2026-02-12T10:58:30.887 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.enable_pipelined_write: 0 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.unordered_write: 0 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.row_cache: None 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.wal_filter: None 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.allow_ingest_behind: 0 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.two_write_queues: 0 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.manual_wal_flush: 0 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.wal_compression: 0 2026-02-12T10:58:30.888 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.atomic_flush: 0 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.log_readahead_size: 0 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.best_efforts_recovery: 0 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.allow_data_in_errors: 0 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.db_host_id: __hostname__ 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-12T10:58:30.889 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_background_jobs: 2 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_background_compactions: -1 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_subcompactions: 1 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_total_wal_size: 0 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_open_files: -1 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bytes_per_sync: 0 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-12T10:58:30.890 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_readahead_size: 0 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_background_flushes: -1 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Compression algorithms supported: 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kZSTD supported: 0 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kXpressCompression supported: 0 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kBZip2Compression supported: 0 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kLZ4Compression supported: 1 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kZlibCompression supported: 1 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kLZ4HCCompression supported: 1 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: kSnappyCompression supported: 1 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-12T10:58:30.891 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-trial031/store.db/MANIFEST-000010 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.merge_operator: 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_filter: None 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_filter_factory: None 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.sst_partitioner_factory: None 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c4be8ee700) 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout: cache_index_and_filter_blocks: 1 2026-02-12T10:58:30.892 INFO:journalctl@ceph.mon.trial031.trial031.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: pin_top_level_index_and_filter: 1 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: index_type: 0 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: data_block_index_type: 0 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: index_shortening: 1 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: checksum: 4 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: no_block_cache: 0 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_cache: 0x55c4be913350 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_cache_name: BinnedLRUCache 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_cache_options: 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: capacity : 536870912 2026-02-12T10:58:30.893 INFO:journalctl@ceph.mon.trial031.trial031.stdout: num_shard_bits : 4 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: strict_capacity_limit : 0 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: high_pri_pool_ratio: 0.000 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_cache_compressed: (nil) 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: persistent_cache: (nil) 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_size: 4096 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_size_deviation: 10 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_restart_interval: 16 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: index_block_restart_interval: 1 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: metadata_block_size: 4096 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: partition_filters: 0 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: use_delta_encoding: 1 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: filter_policy: bloomfilter 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: whole_key_filtering: 1 2026-02-12T10:58:30.894 INFO:journalctl@ceph.mon.trial031.trial031.stdout: verify_compression: 0 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: read_amp_bytes_per_bit: 0 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: format_version: 5 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: enable_index_compression: 1 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: block_align: 0 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: max_auto_readahead_size: 262144 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: prepopulate_block_cache: 0 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: initial_auto_readahead_size: 8192 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout: num_file_reads_for_auto_readahead: 2 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.write_buffer_size: 33554432 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_write_buffer_number: 2 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression: NoCompression 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression: Disabled 2026-02-12T10:58:30.895 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.prefix_extractor: nullptr 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.num_levels: 7 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-12T10:58:30.896 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.level: 32767 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.strategy: 0 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-12T10:58:30.897 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.enabled: false 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.target_file_size_base: 67108864 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-12T10:58:30.898 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.arena_block_size: 1048576 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-12T10:58:30.899 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.disable_auto_compactions: 0 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-12T10:58:30.900 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.inplace_update_support: 0 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.bloom_locality: 0 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.max_successive_merges: 0 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-12T10:58:30.901 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.paranoid_file_checks: 0 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.force_consistency_checks: 1 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.report_bg_io_stats: 0 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.ttl: 2592000 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.enable_blob_files: false 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.min_blob_size: 0 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.blob_file_size: 268435456 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-12T10:58:30.902 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.blob_file_starting_level: 0 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-trial031/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1f547393-06d9-47ad-a270-549dc672db94 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770893910617908, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-12T10:58:30.903 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770893910618725, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 71798, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 221, "table_properties": {"data_size": 70073, "index_size": 174, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9407, "raw_average_key_size": 48, "raw_value_size": 64768, "raw_average_value_size": 337, "num_data_blocks": 8, "num_entries": 192, "num_filter_entries": 192, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770893910, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1f547393-06d9-47ad-a270-549dc672db94", "db_session_id": "NUK7SJMDDOZGME5BNWOP", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770893910618787, "job": 1, "event": "recovery_finished"} 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-trial031/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c4be914e00 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: DB pointer 0x55c4bea22000 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout: ** DB Stats ** 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-12T10:58:30.904 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: ** Compaction Stats [default] ** 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: L0 2/0 72.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:58:30.905 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Sum 2/0 72.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: ** Compaction Stats [default] ** 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 125.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: 2026-02-12T10:58:30.906 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Cumulative compaction: 0.00 GB write, 24.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Interval compaction: 0.00 GB write, 24.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Block cache BinnedLRUCache@0x55c4be913350#7 capacity: 512.00 MB usage: 1.06 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.70 KB,0.00013411%) IndexBlock(2,0.36 KB,6.85453e-05%) Misc(1,0.00 KB,0%) 2026-02-12T10:58:30.907 INFO:journalctl@ceph.mon.trial031.trial031.stdout: 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: starting mon.trial031 rank 0 at public addrs [v2:10.20.193.31:3300/0,v1:10.20.193.31:6789/0] at bind addrs [v2:10.20.193.31:3300/0,v1:10.20.193.31:6789/0] mon_data /var/lib/ceph/mon/ceph-trial031 fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???) e1 preinit fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???).mds e1 new map 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???).mds e1 print_map 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout: e1 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout: btime 2026-02-12T10:58:29:166864+0000 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout: legacy client fscid: -1 2026-02-12T10:58:30.908 INFO:journalctl@ceph.mon.trial031.trial031.stdout: 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout: No filesystems configured 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mon.trial031 is new leader, mons trial031 in quorum (ranks 0) 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: monmap epoch 1 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: last_changed 2026-02-12T10:58:27.960463+0000 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: created 2026-02-12T10:58:27.960463+0000 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: min_mon_release 19 (squid) 2026-02-12T10:58:30.909 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: election_strategy: 1 2026-02-12T10:58:30.910 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: 0: [v2:10.20.193.31:3300/0,v1:10.20.193.31:6789/0] mon.trial031 2026-02-12T10:58:30.910 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: fsmap 2026-02-12T10:58:30.910 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: osdmap e1: 0 total, 0 up, 0 in 2026-02-12T10:58:30.910 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:30 trial031 ceph-mon[17813]: mgrmap e1: no daemons active 2026-02-12T10:58:30.911 INFO:teuthology.orchestra.run.trial031.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-12T10:58:30.911 INFO:teuthology.orchestra.run.trial031.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:58:30.911 INFO:teuthology.orchestra.run.trial031.stdout:Creating mgr... 2026-02-12T10:58:30.911 INFO:teuthology.orchestra.run.trial031.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-12T10:58:30.912 INFO:teuthology.orchestra.run.trial031.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-12T10:58:30.912 INFO:teuthology.orchestra.run.trial031.stdout:Verifying port 0.0.0.0:8443 ... 2026-02-12T10:58:31.022 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mgr.trial031.nmnrzg 2026-02-12T10:58:31.022 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mgr.trial031.nmnrzg.service: Unit ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mgr.trial031.nmnrzg.service not loaded. 2026-02-12T10:58:31.137 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460.target.wants/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mgr.trial031.nmnrzg.service → /etc/systemd/system/ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@.service. 2026-02-12T10:58:31.297 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:58:31.297 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout disabled 2026-02-12T10:58:31.303 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:58:31.303 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout inactive 2026-02-12T10:58:31.303 INFO:teuthology.orchestra.run.trial031.stdout:firewalld.service is not enabled 2026-02-12T10:58:31.303 INFO:teuthology.orchestra.run.trial031.stdout:Not possible to enable service . firewalld.service is not available 2026-02-12T10:58:31.310 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:58:31.310 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout disabled 2026-02-12T10:58:31.316 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:58:31.316 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout inactive 2026-02-12T10:58:31.316 INFO:teuthology.orchestra.run.trial031.stdout:firewalld.service is not enabled 2026-02-12T10:58:31.316 INFO:teuthology.orchestra.run.trial031.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2026-02-12T10:58:31.317 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for mgr to start... 2026-02-12T10:58:31.317 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for mgr... 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "fsid": "bbe50c82-0801-11f1-9f0b-d404e6e7d460", 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "health": { 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:31.603 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 0 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "trial031" 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-12T10:58:31.604 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-12T10:58:31.605 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "btime": "2026-02-12T10:58:29:166864+0000", 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:31.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "restful" 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:31.607 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "modified": "2026-02-12T10:58:29.167245+0000", 2026-02-12T10:58:31.608 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:58:31.608 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:31.608 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-12T10:58:31.608 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:58:31.608 INFO:teuthology.orchestra.run.trial031.stdout:mgr not available, waiting (1/15)... 2026-02-12T10:58:32.081 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:31 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/692091138' entity='client.admin' 2026-02-12T10:58:32.081 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:31 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/4240800174' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "fsid": "bbe50c82-0801-11f1-9f0b-d404e6e7d460", 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "health": { 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 0 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "trial031" 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-12T10:58:33.874 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "btime": "2026-02-12T10:58:29:166864+0000", 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "restful" 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "modified": "2026-02-12T10:58:29.167245+0000", 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-12T10:58:33.875 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:58:33.876 INFO:teuthology.orchestra.run.trial031.stdout:mgr not available, waiting (2/15)... 2026-02-12T10:58:34.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:33 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3479059422' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-12T10:58:35.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: Activating manager daemon trial031.nmnrzg 2026-02-12T10:58:35.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: mgrmap e2: trial031.nmnrzg(active, starting, since 0.00249707s) 2026-02-12T10:58:35.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-12T10:58:35.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-12T10:58:35.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-12T10:58:35.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T10:58:35.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr metadata", "who": "trial031.nmnrzg", "id": "trial031.nmnrzg"}]: dispatch 2026-02-12T10:58:35.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: Manager daemon trial031.nmnrzg is now available 2026-02-12T10:58:35.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/mirror_snapshot_schedule"}]: dispatch 2026-02-12T10:58:35.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:35.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/trash_purge_schedule"}]: dispatch 2026-02-12T10:58:35.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:35.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:34 trial031 ceph-mon[17813]: from='mgr.14100 10.20.193.31:0/2030159817' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:36.239 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:35 trial031 ceph-mon[17813]: mgrmap e3: trial031.nmnrzg(active, since 1.00521s) 2026-02-12T10:58:36.252 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:36.252 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:58:36.252 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "fsid": "bbe50c82-0801-11f1-9f0b-d404e6e7d460", 2026-02-12T10:58:36.252 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "health": { 2026-02-12T10:58:36.252 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 0 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-12T10:58:36.253 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "trial031" 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:36.254 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-12T10:58:36.255 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:36.256 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "btime": "2026-02-12T10:58:29:166864+0000", 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-12T10:58:36.257 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "restful" 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "modified": "2026-02-12T10:58:29.167245+0000", 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:58:36.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:58:36.259 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-12T10:58:36.259 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:58:36.259 INFO:teuthology.orchestra.run.trial031.stdout:mgr is available 2026-02-12T10:58:36.574 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout [global] 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout fsid = bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.31:3300,v1:10.20.193.31:6789] 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 2026-02-12T10:58:36.575 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout [osd] 2026-02-12T10:58:36.576 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-12T10:58:36.576 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-12T10:58:36.576 INFO:teuthology.orchestra.run.trial031.stdout:Enabling cephadm module... 2026-02-12T10:58:37.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:36 trial031 ceph-mon[17813]: mgrmap e4: trial031.nmnrzg(active, since 2s) 2026-02-12T10:58:37.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:36 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1499436705' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-12T10:58:37.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:36 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3350817374' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-12T10:58:37.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:36 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3377127181' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-12T10:58:37.367 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:58:37.367 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-12T10:58:37.367 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-12T10:58:37.367 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "active_name": "trial031.nmnrzg", 2026-02-12T10:58:37.367 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-12T10:58:37.367 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:58:37.368 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for the mgr to restart... 2026-02-12T10:58:37.368 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for mgr epoch 5... 2026-02-12T10:58:38.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:37 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3377127181' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-12T10:58:38.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:37 trial031 ceph-mon[17813]: mgrmap e5: trial031.nmnrzg(active, since 3s) 2026-02-12T10:58:38.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:37 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2209414252' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-12T10:58:39.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: Active manager daemon trial031.nmnrzg restarted 2026-02-12T10:58:39.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: Activating manager daemon trial031.nmnrzg 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: osdmap e2: 0 total, 0 up, 0 in 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: mgrmap e6: trial031.nmnrzg(active, starting, since 0.00272822s) 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr metadata", "who": "trial031.nmnrzg", "id": "trial031.nmnrzg"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: Manager daemon trial031.nmnrzg is now available 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/mirror_snapshot_schedule"}]: dispatch 2026-02-12T10:58:39.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:39 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/trash_purge_schedule"}]: dispatch 2026-02-12T10:58:40.627 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:58:40.628 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-12T10:58:40.628 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-12T10:58:40.628 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:58:40.628 INFO:teuthology.orchestra.run.trial031.stdout:mgr epoch 5 is available 2026-02-12T10:58:40.628 INFO:teuthology.orchestra.run.trial031.stdout:Setting orchestrator backend to cephadm... 2026-02-12T10:58:40.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:40 trial031 ceph-mon[17813]: Found migration_current of "None". Setting to last migration. 2026-02-12T10:58:40.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:40 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:40.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:40 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:40.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:40 trial031 ceph-mon[17813]: mgrmap e7: trial031.nmnrzg(active, since 1.00359s) 2026-02-12T10:58:41.291 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-12T10:58:41.291 INFO:teuthology.orchestra.run.trial031.stdout:Generating ssh key... 2026-02-12T10:58:41.857 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:40] ENGINE Bus STARTING 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:40] ENGINE Serving on http://10.20.193.31:8765 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:40] ENGINE Serving on https://10.20.193.31:7150 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:40] ENGINE Bus STARTED 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:40] ENGINE Client ('10.20.193.31', 32976) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:41.858 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:41 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:41.981 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM/NFR+wUCizNL0aKsOGJ1owlufSwM0un0uHDeLVb25L ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:41.982 INFO:teuthology.orchestra.run.trial031.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-12T10:58:41.982 INFO:teuthology.orchestra.run.trial031.stdout:Adding key to root@localhost authorized_keys... 2026-02-12T10:58:41.982 INFO:teuthology.orchestra.run.trial031.stdout:Adding host trial031... 2026-02-12T10:58:43.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:42 trial031 ceph-mon[17813]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:43.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:42 trial031 ceph-mon[17813]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:43.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:42 trial031 ceph-mon[17813]: Generating ssh key... 2026-02-12T10:58:43.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:42 trial031 ceph-mon[17813]: mgrmap e8: trial031.nmnrzg(active, since 2s) 2026-02-12T10:58:43.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:42 trial031 ceph-mon[17813]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:43.791 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Added host 'trial031' with addr '10.20.193.31' 2026-02-12T10:58:43.791 INFO:teuthology.orchestra.run.trial031.stdout:Deploying mon service with default placement... 2026-02-12T10:58:44.002 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:43 trial031 ceph-mon[17813]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial031", "addr": "10.20.193.31", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:44.003 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:43 trial031 ceph-mon[17813]: Deploying cephadm binary to trial031 2026-02-12T10:58:44.003 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:43 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:44.003 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:43 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:58:44.132 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-12T10:58:44.133 INFO:teuthology.orchestra.run.trial031.stdout:Deploying mgr service with default placement... 2026-02-12T10:58:44.549 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-12T10:58:44.549 INFO:teuthology.orchestra.run.trial031.stdout:Deploying crash service with default placement... 2026-02-12T10:58:44.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:44 trial031 ceph-mon[17813]: Added host trial031 2026-02-12T10:58:44.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:44 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:44.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:44 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:44.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:44 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:44.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:44 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:44.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:44 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:44.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:44 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:44.901 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2026-02-12T10:58:44.901 INFO:teuthology.orchestra.run.trial031.stdout:Deploying ceph-exporter service with default placement... 2026-02-12T10:58:45.251 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2026-02-12T10:58:45.251 INFO:teuthology.orchestra.run.trial031.stdout:Deploying prometheus service with default placement... 2026-02-12T10:58:45.593 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2026-02-12T10:58:45.594 INFO:teuthology.orchestra.run.trial031.stdout:Deploying grafana service with default placement... 2026-02-12T10:58:45.925 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2026-02-12T10:58:45.925 INFO:teuthology.orchestra.run.trial031.stdout:Deploying node-exporter service with default placement... 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: Saving service mon spec with placement count:5 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: Saving service mgr spec with placement count:2 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: Saving service crash spec with placement * 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:46.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:45 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:46.258 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2026-02-12T10:58:46.258 INFO:teuthology.orchestra.run.trial031.stdout:Deploying alertmanager service with default placement... 2026-02-12T10:58:46.592 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: Saving service ceph-exporter spec with placement * 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: Saving service prometheus spec with placement count:1 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: Saving service grafana spec with placement count:1 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: from='mgr.14118 10.20.193.31:0/2568936927' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:47.037 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:46 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2630337282' entity='client.admin' 2026-02-12T10:58:47.249 INFO:teuthology.orchestra.run.trial031.stdout:Enabling the dashboard module... 2026-02-12T10:58:48.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:47 trial031 ceph-mon[17813]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:48.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:47 trial031 ceph-mon[17813]: Saving service node-exporter spec with placement * 2026-02-12T10:58:48.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:47 trial031 ceph-mon[17813]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:48.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:47 trial031 ceph-mon[17813]: Saving service alertmanager spec with placement count:1 2026-02-12T10:58:48.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:47 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2549311676' entity='client.admin' 2026-02-12T10:58:48.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:47 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3409700483' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-12T10:58:48.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:58:48.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-12T10:58:48.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-12T10:58:48.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "active_name": "trial031.nmnrzg", 2026-02-12T10:58:48.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-12T10:58:48.606 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:58:48.607 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for the mgr to restart... 2026-02-12T10:58:48.607 INFO:teuthology.orchestra.run.trial031.stdout:Waiting for mgr epoch 9... 2026-02-12T10:58:49.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:49 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3409700483' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-12T10:58:49.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:49 trial031 ceph-mon[17813]: mgrmap e9: trial031.nmnrzg(active, since 8s) 2026-02-12T10:58:49.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:49 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/471316945' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: Active manager daemon trial031.nmnrzg restarted 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: Activating manager daemon trial031.nmnrzg 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: osdmap e3: 0 total, 0 up, 0 in 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: mgrmap e10: trial031.nmnrzg(active, starting, since 0.00240891s) 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr metadata", "who": "trial031.nmnrzg", "id": "trial031.nmnrzg"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: Manager daemon trial031.nmnrzg is now available 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/mirror_snapshot_schedule"}]: dispatch 2026-02-12T10:58:51.125 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:50 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/trash_purge_schedule"}]: dispatch 2026-02-12T10:58:51.886 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:58:51.886 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-12T10:58:51.887 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-12T10:58:51.887 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:58:51.887 INFO:teuthology.orchestra.run.trial031.stdout:mgr epoch 9 is available 2026-02-12T10:58:51.887 INFO:teuthology.orchestra.run.trial031.stdout:Generating a dashboard self-signed certificate... 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: mgrmap e11: trial031.nmnrzg(active, since 1.00423s) 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:51] ENGINE Bus STARTING 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:51] ENGINE Serving on https://10.20.193.31:7150 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:51] ENGINE Client ('10.20.193.31', 58408) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:51] ENGINE Serving on http://10.20.193.31:8765 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: [12/Feb/2026:10:58:51] ENGINE Bus STARTED 2026-02-12T10:58:52.343 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:52 trial031 ceph-mon[17813]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:52.348 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-12T10:58:52.349 INFO:teuthology.orchestra.run.trial031.stdout:Creating initial admin user... 2026-02-12T10:58:52.890 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$zej0cLDMfbp.CFJgcSo1yeoGFyKW7vwpoVzfkRhGLhQs98P.1j/9S", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1770893932, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-12T10:58:52.890 INFO:teuthology.orchestra.run.trial031.stdout:Fetching dashboard port number... 2026-02-12T10:58:53.214 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stdout 8443 2026-02-12T10:58:53.223 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:58:53.223 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout disabled 2026-02-12T10:58:53.229 INFO:teuthology.orchestra.run.trial031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:58:53.229 INFO:teuthology.orchestra.run.trial031.stdout:systemctl: stdout inactive 2026-02-12T10:58:53.230 INFO:teuthology.orchestra.run.trial031.stdout:firewalld.service is not enabled 2026-02-12T10:58:53.230 INFO:teuthology.orchestra.run.trial031.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-12T10:58:53.230 INFO:teuthology.orchestra.run.trial031.stdout:Ceph Dashboard is now available at: 2026-02-12T10:58:53.230 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.230 INFO:teuthology.orchestra.run.trial031.stdout: URL: https://trial031:8443/ 2026-02-12T10:58:53.231 INFO:teuthology.orchestra.run.trial031.stdout: User: admin 2026-02-12T10:58:53.231 INFO:teuthology.orchestra.run.trial031.stdout: Password: j3j953hze8 2026-02-12T10:58:53.231 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.231 INFO:teuthology.orchestra.run.trial031.stdout:Saving cluster configuration to /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config directory 2026-02-12T10:58:53.346 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:53 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:53.346 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:53 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:53.346 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:53 trial031 ceph-mon[17813]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:53.346 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:53 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:53.346 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:53 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/817871534' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-12T10:58:53.600 INFO:teuthology.orchestra.run.trial031.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-12T10:58:53.600 INFO:teuthology.orchestra.run.trial031.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-12T10:58:53.600 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.600 INFO:teuthology.orchestra.run.trial031.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:58:53.600 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.600 INFO:teuthology.orchestra.run.trial031.stdout:Or, if you are only running a single cluster on this host: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: ceph telemetry on 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout:For more information see: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:53.601 INFO:teuthology.orchestra.run.trial031.stdout:Bootstrap complete. 2026-02-12T10:58:53.626 INFO:tasks.cephadm:Fetching config... 2026-02-12T10:58:53.627 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:53.627 DEBUG:teuthology.orchestra.run.trial031:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-12T10:58:53.644 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-12T10:58:53.644 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:53.645 DEBUG:teuthology.orchestra.run.trial031:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-12T10:58:53.702 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-12T10:58:53.702 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:53.702 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/keyring of=/dev/stdout 2026-02-12T10:58:53.767 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-12T10:58:53.768 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:58:53.768 DEBUG:teuthology.orchestra.run.trial031:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-12T10:58:53.824 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-12T10:58:53.825 DEBUG:teuthology.orchestra.run.trial031:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM/NFR+wUCizNL0aKsOGJ1owlufSwM0un0uHDeLVb25L ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-12T10:58:53.899 INFO:teuthology.orchestra.run.trial031.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM/NFR+wUCizNL0aKsOGJ1owlufSwM0un0uHDeLVb25L ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:53.910 DEBUG:teuthology.orchestra.run.trial069:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM/NFR+wUCizNL0aKsOGJ1owlufSwM0un0uHDeLVb25L ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-12T10:58:53.945 INFO:teuthology.orchestra.run.trial069.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM/NFR+wUCizNL0aKsOGJ1owlufSwM0un0uHDeLVb25L ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:58:53.956 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-12T10:58:54.102 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:58:54.444 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:54 trial031 ceph-mon[17813]: mgrmap e12: trial031.nmnrzg(active, since 2s) 2026-02-12T10:58:54.444 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:54 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1908593931' entity='client.admin' 2026-02-12T10:58:54.463 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-12T10:58:54.464 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-12T10:58:54.628 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:58:54.993 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial069 2026-02-12T10:58:54.994 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:58:54.994 DEBUG:teuthology.orchestra.run.trial069:> dd of=/etc/ceph/ceph.conf 2026-02-12T10:58:55.010 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:58:55.010 DEBUG:teuthology.orchestra.run.trial069:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:58:55.066 INFO:tasks.cephadm:Adding host trial069 to orchestrator... 2026-02-12T10:58:55.067 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph orch host add trial069 2026-02-12T10:58:55.215 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:58:55.517 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:55 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1080888391' entity='client.admin' 2026-02-12T10:58:55.518 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:55 trial031 ceph-mon[17813]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:55.518 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:55 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial069", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd/host:trial031", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: Updating trial031:/etc/ceph/ceph.conf 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: Updating trial031:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: Deploying cephadm binary to trial069 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: Updating trial031:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: Updating trial031:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-12T10:58:56.677 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:56 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:58:56.953 INFO:teuthology.orchestra.run.trial031.stdout:Added host 'trial069' with addr '10.20.193.69' 2026-02-12T10:58:57.096 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-12T10:58:57.242 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:58:57.468 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:58:57.468 INFO:teuthology.orchestra.run.trial031.stdout:[{"addr": "10.20.193.31", "hostname": "trial031", "labels": [], "status": ""}, {"addr": "10.20.193.69", "hostname": "trial069", "labels": [], "status": ""}] 2026-02-12T10:58:57.606 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-12T10:58:57.607 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd crush tunables default 2026-02-12T10:58:57.875 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:58:58.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: Deploying daemon ceph-exporter.trial031 on trial031 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: Added host trial069 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-12T10:58:58.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:58:58.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: Deploying daemon crash.trial031 on trial031 2026-02-12T10:58:58.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: mgrmap e13: trial031.nmnrzg(active, since 6s) 2026-02-12T10:58:58.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:57 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:58:58.956 INFO:teuthology.orchestra.run.trial031.stderr:adjusted tunables profile to default 2026-02-12T10:58:59.053 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:58 trial031 ceph-mon[17813]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:58:59.053 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:58 trial031 ceph-mon[17813]: Deploying daemon node-exporter.trial031 on trial031 2026-02-12T10:58:59.053 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:58 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3652269828' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-12T10:58:59.117 INFO:tasks.cephadm:Adding mon.trial031 on trial031 2026-02-12T10:58:59.117 INFO:tasks.cephadm:Adding mon.trial069 on trial069 2026-02-12T10:58:59.118 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph orch apply mon '2;trial031:10.20.193.31=trial031;trial069:10.20.193.69=trial069' 2026-02-12T10:58:59.258 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:58:59.288 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:58:59.557 INFO:teuthology.orchestra.run.trial069.stdout:Scheduled mon update... 2026-02-12T10:58:59.698 DEBUG:teuthology.orchestra.run.trial069:mon.trial069> sudo journalctl -f -n 0 -u ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial069.service 2026-02-12T10:58:59.701 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:58:59.701 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:58:59.879 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:58:59.908 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:00.187 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:00.187 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:00.187 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:00.261 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3652269828' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-12T10:59:00.261 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: osdmap e4: 0 total, 0 up, 0 in 2026-02-12T10:59:00.261 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:00.261 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:00.261 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:00.261 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:00.261 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: Deploying daemon alertmanager.trial031 on trial031 2026-02-12T10:59:00.262 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:58:59 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;trial031:10.20.193.31=trial031;trial069:10.20.193.69=trial069", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: Saving service mon spec with placement trial031:10.20.193.31=trial031;trial069:10.20.193.69=trial069;count:2 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2377339050' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:00 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:01.326 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:01.327 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:01.468 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:01.497 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:01.752 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:01.752 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:01.752 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: Regenerating cephadm self-signed grafana TLS certificates 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: Deploying daemon grafana.trial031 on trial031 2026-02-12T10:59:02.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:01 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2414573446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:02.892 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:02.892 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:03.033 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:03.061 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:03.337 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:03.337 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:03.338 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:03.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:03 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2141292928' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:04.475 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:04.475 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:04.622 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:04.651 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:04.926 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:04.926 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:04.926 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:05.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/3583166563' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:05.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:05.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:05.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:05.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:05.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:05.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:05.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:05.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:04 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:06.065 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:06.065 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:06.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:05 trial031 ceph-mon[17813]: Deploying daemon prometheus.trial031 on trial031 2026-02-12T10:59:06.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:05 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:06.206 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:06.237 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:06.499 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:06.499 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:06.500 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:07.381 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:06 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/3797776880' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:07.637 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:07.638 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:07.781 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:07.811 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:08.071 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:08.072 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:08.072 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:08.369 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:08 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/3502907879' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:09.211 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:09.211 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:09.352 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:09.380 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:09.682 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:09.682 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:09.682 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:09.830 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:09 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:09.830 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:09 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:09.831 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:09 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:09.831 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:09 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-02-12T10:59:10.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:10 trial031 ceph-mon[17813]: from='mgr.14162 10.20.193.31:0/3806990150' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-12T10:59:10.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:10 trial031 ceph-mon[17813]: mgrmap e14: trial031.nmnrzg(active, since 18s) 2026-02-12T10:59:10.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:10 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/3280878533' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:10.821 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:10.821 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:10.966 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:10.994 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:11.276 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:11.276 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:11.277 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:11.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:11 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2481004333' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:12.417 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:12.417 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:12.557 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:12.587 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: Active manager daemon trial031.nmnrzg restarted 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: Activating manager daemon trial031.nmnrzg 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: osdmap e5: 0 total, 0 up, 0 in 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: mgrmap e15: trial031.nmnrzg(active, starting, since 0.0025754s) 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr metadata", "who": "trial031.nmnrzg", "id": "trial031.nmnrzg"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: Manager daemon trial031.nmnrzg is now available 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/mirror_snapshot_schedule"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial031.nmnrzg/trash_purge_schedule"}]: dispatch 2026-02-12T10:59:12.680 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:12.868 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:12.868 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:12.869 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/1482206886' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: [12/Feb/2026:10:59:12] ENGINE Bus STARTING 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: [12/Feb/2026:10:59:12] ENGINE Serving on https://10.20.193.31:7150 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: [12/Feb/2026:10:59:12] ENGINE Client ('10.20.193.31', 36018) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: mgrmap e16: trial031.nmnrzg(active, since 1.00469s) 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:13.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: [12/Feb/2026:10:59:13] ENGINE Serving on http://10.20.193.31:8765 2026-02-12T10:59:13.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: [12/Feb/2026:10:59:13] ENGINE Bus STARTED 2026-02-12T10:59:13.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:13.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:13.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:13.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:13 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd/host:trial031", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:59:14.030 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:14.030 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:14.180 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:14.214 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-12T10:59:14.487 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:14.487 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:14.487 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:14.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/1224471152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:14.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:14.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:14.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:14.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:14.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd/host:trial069", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:59:14.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:14.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:14 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:59:15.626 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:15.627 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:15.795 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:59:15.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial031:/etc/ceph/ceph.conf 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial069:/etc/ceph/ceph.conf 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: mgrmap e17: trial031.nmnrzg(active, since 2s) 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial069:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial031:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial069:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial031:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial069:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Updating trial031:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:15.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:15.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:15.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:15.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:15.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial069", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-12T10:59:15.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial069", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-12T10:59:15.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:15.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:15 trial031 ceph-mon[17813]: Deploying daemon ceph-exporter.trial069 on trial069 2026-02-12T10:59:16.316 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:16.316 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:16.316 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:17.381 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: Deploying daemon crash.trial069 on trial069 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/1886045286' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:17.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.383 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.383 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.383 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.383 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:17 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:17.458 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:17.458 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:17.633 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:59:17.886 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:17.886 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:17.887 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:18.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: Deploying daemon node-exporter.trial069 on trial069 2026-02-12T10:59:18.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/1600105750' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:18.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:18.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:18.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:18.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:18.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial069.azktyl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:59:18.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.trial069.azktyl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-12T10:59:18.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:59:18.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:18 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:19.181 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:19.181 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:19.450 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:59:19.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:19 trial031 ceph-mon[17813]: Deploying daemon mgr.trial069.azktyl on trial069 2026-02-12T10:59:19.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:19 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:19.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:19 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:19.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:19 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:19.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:19 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:19.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:19 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:59:19.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:19 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:19.709 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:19.710 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":1,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:58:27.960463Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:59:19.710 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 1 2026-02-12T10:59:20.852 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-12T10:59:20.853 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:59:21.002 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial069/config 2026-02-12T10:59:25.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T10:59:25.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T10:59:25.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: mon.trial031 calling monitor election 2026-02-12T10:59:25.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.? 10.20.193.69:0/80326741' entity='mgr.trial069.azktyl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial069.azktyl/crt"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: mon.trial069 calling monitor election 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: mon.trial031 is new leader, mons trial031,trial069 in quorum (ranks 0,1) 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: monmap epoch 2 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: last_changed 2026-02-12T10:59:20.143242+0000 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: created 2026-02-12T10:58:27.960463+0000 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: min_mon_release 19 (squid) 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: election_strategy: 1 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: 0: [v2:10.20.193.31:3300/0,v1:10.20.193.31:6789/0] mon.trial031 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: 1: [v2:10.20.193.69:3300/0,v1:10.20.193.69:6789/0] mon.trial069 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: fsmap 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: osdmap e5: 0 total, 0 up, 0 in 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: mgrmap e17: trial031.nmnrzg(active, since 13s) 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: overall HEALTH_OK 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: Standby manager daemon trial069.azktyl started 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.? 10.20.193.69:0/80326741' entity='mgr.trial069.azktyl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.? 10.20.193.69:0/80326741' entity='mgr.trial069.azktyl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial069.azktyl/key"}]: dispatch 2026-02-12T10:59:25.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:25 trial031 ceph-mon[17813]: from='mgr.? 10.20.193.69:0/80326741' entity='mgr.trial069.azktyl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-12T10:59:25.672 INFO:teuthology.orchestra.run.trial069.stdout: 2026-02-12T10:59:25.672 INFO:teuthology.orchestra.run.trial069.stdout:{"epoch":2,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","modified":"2026-02-12T10:59:20.143242Z","created":"2026-02-12T10:58:27.960463Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial031","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:3300","nonce":0},{"type":"v1","addr":"10.20.193.31:6789","nonce":0}]},"addr":"10.20.193.31:6789/0","public_addr":"10.20.193.31:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"trial069","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:3300","nonce":0},{"type":"v1","addr":"10.20.193.69:6789","nonce":0}]},"addr":"10.20.193.69:6789/0","public_addr":"10.20.193.69:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-12T10:59:25.672 INFO:teuthology.orchestra.run.trial069.stderr:dumped monmap epoch 2 2026-02-12T10:59:25.810 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-12T10:59:25.811 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-12T10:59:25.965 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:26.186 INFO:teuthology.orchestra.run.trial031.stdout:# minimal ceph.conf for bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:59:26.186 INFO:teuthology.orchestra.run.trial031.stdout:[global] 2026-02-12T10:59:26.186 INFO:teuthology.orchestra.run.trial031.stdout: fsid = bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T10:59:26.186 INFO:teuthology.orchestra.run.trial031.stdout: mon_host = [v2:10.20.193.31:3300/0,v1:10.20.193.31:6789/0] [v2:10.20.193.69:3300/0,v1:10.20.193.69:6789/0] 2026-02-12T10:59:26.351 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-12T10:59:26.351 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:59:26.351 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/ceph.conf 2026-02-12T10:59:26.374 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: mgrmap e18: trial031.nmnrzg(active, since 13s), standbys: trial069.azktyl 2026-02-12T10:59:26.374 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr metadata", "who": "trial069.azktyl", "id": "trial069.azktyl"}]: dispatch 2026-02-12T10:59:26.374 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:26.374 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:26.374 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:26.374 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:59:26.374 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/803574353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T10:59:26.375 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:26 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/581253739' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:26.378 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:59:26.378 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:59:26.448 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:59:26.448 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/etc/ceph/ceph.conf 2026-02-12T10:59:26.474 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:59:26.475 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:59:26.538 INFO:tasks.cephadm:Deploying OSDs... 2026-02-12T10:59:26.538 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T10:59:26.538 DEBUG:teuthology.orchestra.run.trial031:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:59:26.555 DEBUG:teuthology.misc:devs=['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-12T10:59:26.555 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/nvme3n1 2026-02-12T10:59:26.612 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/nvme3n1 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1328 Links: 1 Device type: 103,6 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:55.382076293 +0000 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:11.901390995 +0000 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:11.901390995 +0000 2026-02-12T10:59:26.613 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:10.973406972 +0000 2026-02-12T10:59:26.614 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2026-02-12T10:59:26.677 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:59:26.677 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:59:26.677 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000170727 s, 3.0 MB/s 2026-02-12T10:59:26.678 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2026-02-12T10:59:26.736 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/nvme4n1 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/nvme4n1 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1340 Links: 1 Device type: 103,8 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:55.426075535 +0000 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:12.299967144 +0000 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:12.299967144 +0000 2026-02-12T10:59:26.792 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:11.112404579 +0000 2026-02-12T10:59:26.792 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2026-02-12T10:59:26.853 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:59:26.853 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:59:26.854 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000175546 s, 2.9 MB/s 2026-02-12T10:59:26.855 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2026-02-12T10:59:26.912 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/nvme5n1 2026-02-12T10:59:26.967 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/nvme5n1 2026-02-12T10:59:26.967 INFO:teuthology.orchestra.run.trial031.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:26.968 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1352 Links: 1 Device type: 103,a 2026-02-12T10:59:26.968 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:26.968 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:26.968 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:55.472074743 +0000 2026-02-12T10:59:26.968 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:12.699453500 +0000 2026-02-12T10:59:26.968 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:12.699453500 +0000 2026-02-12T10:59:26.968 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:11.241402358 +0000 2026-02-12T10:59:26.968 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/nvme5n1 of=/dev/null count=1 2026-02-12T10:59:27.031 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:59:27.032 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:59:27.032 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000168333 s, 3.0 MB/s 2026-02-12T10:59:27.032 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/nvme5n1 2026-02-12T10:59:27.089 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/nvme6n1 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/nvme6n1 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1364 Links: 1 Device type: 103,c 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-12 10:58:55.515074003 +0000 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-12 10:58:13.109101747 +0000 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-12 10:58:13.109101747 +0000 2026-02-12T10:59:27.145 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-12 10:58:11.369400154 +0000 2026-02-12T10:59:27.146 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/nvme6n1 of=/dev/null count=1 2026-02-12T10:59:27.210 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-12T10:59:27.210 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-12T10:59:27.210 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000177019 s, 2.9 MB/s 2026-02-12T10:59:27.211 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/nvme6n1 2026-02-12T10:59:27.269 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T10:59:27.269 DEBUG:teuthology.orchestra.run.trial069:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:59:27.287 DEBUG:teuthology.misc:devs=['/dev/nvme3n1', '/dev/nvme4n1', '/dev/nvme5n1', '/dev/nvme6n1'] 2026-02-12T10:59:27.288 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/nvme3n1 2026-02-12T10:59:27.343 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/nvme3n1 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1328 Links: 1 Device type: 103,6 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:59:14.274901871 +0000 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:15.102902789 +0000 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:15.102902789 +0000 2026-02-12T10:59:27.344 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:14.166910630 +0000 2026-02-12T10:59:27.345 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2026-02-12T10:59:27.408 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:59:27.408 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:59:27.408 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000162073 s, 3.2 MB/s 2026-02-12T10:59:27.409 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2026-02-12T10:59:27.466 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/nvme4n1 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Updating trial031:/etc/ceph/ceph.conf 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Updating trial069:/etc/ceph/ceph.conf 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Updating trial069:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Updating trial031:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/config/ceph.conf 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Reconfiguring mon.trial031 (unknown last config time)... 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Reconfiguring daemon mon.trial031 on trial031 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Reconfiguring mgr.trial031.nmnrzg (unknown last config time)... 2026-02-12T10:59:27.503 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial031.nmnrzg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: Reconfiguring daemon mgr.trial031.nmnrzg on trial031 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:27.504 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:27 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T10:59:27.522 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/nvme4n1 2026-02-12T10:59:27.522 INFO:teuthology.orchestra.run.trial069.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:27.523 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1340 Links: 1 Device type: 103,8 2026-02-12T10:59:27.523 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:27.523 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:27.523 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:59:14.316901161 +0000 2026-02-12T10:59:27.523 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:15.502896023 +0000 2026-02-12T10:59:27.523 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:15.502896023 +0000 2026-02-12T10:59:27.523 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:14.304912861 +0000 2026-02-12T10:59:27.523 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2026-02-12T10:59:27.585 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:59:27.585 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:59:27.585 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000159227 s, 3.2 MB/s 2026-02-12T10:59:27.586 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2026-02-12T10:59:27.643 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/nvme5n1 2026-02-12T10:59:27.699 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/nvme5n1 2026-02-12T10:59:27.699 INFO:teuthology.orchestra.run.trial069.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:27.699 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1352 Links: 1 Device type: 103,a 2026-02-12T10:59:27.699 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:27.700 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:27.700 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:59:14.358900450 +0000 2026-02-12T10:59:27.700 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:15.899889308 +0000 2026-02-12T10:59:27.700 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:15.899889308 +0000 2026-02-12T10:59:27.700 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:14.431914139 +0000 2026-02-12T10:59:27.700 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/nvme5n1 of=/dev/null count=1 2026-02-12T10:59:27.764 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:59:27.764 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:59:27.764 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000155069 s, 3.3 MB/s 2026-02-12T10:59:27.765 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/nvme5n1 2026-02-12T10:59:27.824 DEBUG:teuthology.orchestra.run.trial069:> stat /dev/nvme6n1 2026-02-12T10:59:27.880 INFO:teuthology.orchestra.run.trial069.stdout: File: /dev/nvme6n1 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout:Device: 6h/6d Inode: 1364 Links: 1 Device type: 103,c 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout:Access: 2026-02-12 10:59:14.397899791 +0000 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout:Modify: 2026-02-12 10:58:16.298882559 +0000 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout:Change: 2026-02-12 10:58:16.298882559 +0000 2026-02-12T10:59:27.881 INFO:teuthology.orchestra.run.trial069.stdout: Birth: 2026-02-12 10:58:14.554912058 +0000 2026-02-12T10:59:27.882 DEBUG:teuthology.orchestra.run.trial069:> sudo dd if=/dev/nvme6n1 of=/dev/null count=1 2026-02-12T10:59:27.945 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records in 2026-02-12T10:59:27.945 INFO:teuthology.orchestra.run.trial069.stderr:1+0 records out 2026-02-12T10:59:27.945 INFO:teuthology.orchestra.run.trial069.stderr:512 bytes copied, 0.000166681 s, 3.1 MB/s 2026-02-12T10:59:27.946 DEBUG:teuthology.orchestra.run.trial069:> ! mount | grep -v devtmpfs | grep -q /dev/nvme6n1 2026-02-12T10:59:28.005 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph orch apply osd --all-available-devices 2026-02-12T10:59:28.193 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial069/config 2026-02-12T10:59:28.415 INFO:teuthology.orchestra.run.trial069.stdout:Scheduled osd.all-available-devices update... 2026-02-12T10:59:28.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:28 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:28.553 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-02-12T10:59:28.553 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:28.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: Reconfiguring ceph-exporter.trial031 (monmap changed)... 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: Reconfiguring daemon ceph-exporter.trial031 on trial031 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: Reconfiguring crash.trial031 (monmap changed)... 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: Reconfiguring daemon crash.trial031 on trial031 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: Reconfiguring alertmanager.trial031 (dependencies changed)... 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: Reconfiguring daemon alertmanager.trial031 on trial031 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:28.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:28 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:28.827 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:29.046 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:29.188 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2026-02-12T10:59:29.716 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:29 trial069 ceph-mon[25012]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch apply osd", "all_available_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:59:29.716 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:29 trial069 ceph-mon[25012]: Marking host: trial031 for OSDSpec preview refresh. 2026-02-12T10:59:29.716 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:29 trial069 ceph-mon[25012]: Marking host: trial069 for OSDSpec preview refresh. 2026-02-12T10:59:29.716 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:29 trial069 ceph-mon[25012]: Saving service osd.all-available-devices spec with placement * 2026-02-12T10:59:29.716 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:29 trial069 ceph-mon[25012]: Reconfiguring grafana.trial031 (dependencies changed)... 2026-02-12T10:59:29.716 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:29 trial069 ceph-mon[25012]: Reconfiguring daemon grafana.trial031 on trial031 2026-02-12T10:59:29.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:29 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2626284316' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:29.730 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:29 trial031 ceph-mon[17813]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch apply osd", "all_available_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:59:29.730 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:29 trial031 ceph-mon[17813]: Marking host: trial031 for OSDSpec preview refresh. 2026-02-12T10:59:29.730 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:29 trial031 ceph-mon[17813]: Marking host: trial069 for OSDSpec preview refresh. 2026-02-12T10:59:29.730 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:29 trial031 ceph-mon[17813]: Saving service osd.all-available-devices spec with placement * 2026-02-12T10:59:29.730 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:29 trial031 ceph-mon[17813]: Reconfiguring grafana.trial031 (dependencies changed)... 2026-02-12T10:59:29.730 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:29 trial031 ceph-mon[17813]: Reconfiguring daemon grafana.trial031 on trial031 2026-02-12T10:59:29.730 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:29 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2626284316' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:30.189 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:30.349 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:30.571 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:30.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:30 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:30.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:30 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:30.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:30 trial031 ceph-mon[17813]: Reconfiguring prometheus.trial031 (dependencies changed)... 2026-02-12T10:59:30.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:30 trial031 ceph-mon[17813]: Reconfiguring daemon prometheus.trial031 on trial031 2026-02-12T10:59:30.716 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2026-02-12T10:59:30.875 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:30 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:30.875 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:30 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:30.875 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:30 trial069 ceph-mon[25012]: Reconfiguring prometheus.trial031 (dependencies changed)... 2026-02-12T10:59:30.875 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:30 trial069 ceph-mon[25012]: Reconfiguring daemon prometheus.trial031 on trial031 2026-02-12T10:59:31.718 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/4109224841' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: Reconfiguring ceph-exporter.trial069 (monmap changed)... 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial069", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: Reconfiguring daemon ceph-exporter.trial069 on trial069 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: Reconfiguring crash.trial069 (monmap changed)... 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: Reconfiguring daemon crash.trial069 on trial069 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.877 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.878 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: Reconfiguring mgr.trial069.azktyl (monmap changed)... 2026-02-12T10:59:31.878 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial069.azktyl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:59:31.878 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:59:31.878 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:31.878 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:31 trial069 ceph-mon[25012]: Reconfiguring daemon mgr.trial069.azktyl on trial069 2026-02-12T10:59:31.878 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/4109224841' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: Reconfiguring ceph-exporter.trial069 (monmap changed)... 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial069", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: Reconfiguring daemon ceph-exporter.trial069 on trial069 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: Reconfiguring crash.trial069 (monmap changed)... 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: Reconfiguring daemon crash.trial069 on trial069 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:31.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: Reconfiguring mgr.trial069.azktyl (monmap changed)... 2026-02-12T10:59:31.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial069.azktyl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:59:31.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:59:31.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:31.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:31 trial031 ceph-mon[17813]: Reconfiguring daemon mgr.trial069.azktyl on trial069 2026-02-12T10:59:32.091 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:32.229 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2026-02-12T10:59:33.064 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: Reconfiguring mon.trial069 (monmap changed)... 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: Reconfiguring daemon mon.trial069 on trial069 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3357713849' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.065 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial031:9093"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial031:9093"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial031:3000"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial031:3000"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-12T10:59:33.066 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial031:9095"}]: dispatch 2026-02-12T10:59:33.067 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial031:9095"}]: dispatch 2026-02-12T10:59:33.067 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.067 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:59:33.067 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.067 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.067 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.067 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:32 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: Reconfiguring mon.trial069 (monmap changed)... 2026-02-12T10:59:33.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:59:33.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:59:33.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:33.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: Reconfiguring daemon mon.trial069 on trial069 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3357713849' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial031:9093"}]: dispatch 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial031:9093"}]: dispatch 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-12T10:59:33.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial031:3000"}]: dispatch 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial031:3000"}]: dispatch 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial031:9095"}]: dispatch 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial031:9095"}]: dispatch 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:32 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:33.230 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:33.384 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:33.596 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:33.734 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2026-02-12T10:59:34.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:34.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:59:34.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:34.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:34 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2008078589' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:59:34.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:34.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:59:34.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:34.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:34 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2008078589' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:34.735 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:34.890 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:35.115 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:35.257 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":7,"num_osds":2,"num_up_osds":0,"osd_up_since":0,"num_in_osds":2,"osd_in_since":1770893974,"num_remapped_pgs":0} 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2577740195' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8ba8df9-1916-4316-a03c-1edeac15d66b"}]: dispatch 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8ba8df9-1916-4316-a03c-1edeac15d66b"}]: dispatch 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8ba8df9-1916-4316-a03c-1edeac15d66b"}]': finished 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: osdmap e6: 1 total, 0 up, 1 in 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1466694600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4f06536-725e-43f0-b148-3f6df879dd07"}]: dispatch 2026-02-12T10:59:35.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1466694600' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4f06536-725e-43f0-b148-3f6df879dd07"}]': finished 2026-02-12T10:59:35.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: osdmap e7: 2 total, 0 up, 2 in 2026-02-12T10:59:35.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:35.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:35.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2877050986' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:35.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2712695426' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:35.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:35 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3035754752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/2577740195' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8ba8df9-1916-4316-a03c-1edeac15d66b"}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8ba8df9-1916-4316-a03c-1edeac15d66b"}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8ba8df9-1916-4316-a03c-1edeac15d66b"}]': finished 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: osdmap e6: 1 total, 0 up, 1 in 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1466694600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4f06536-725e-43f0-b148-3f6df879dd07"}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1466694600' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4f06536-725e-43f0-b148-3f6df879dd07"}]': finished 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: osdmap e7: 2 total, 0 up, 2 in 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2877050986' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/2712695426' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:35.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:35 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3035754752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:36.258 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:36.410 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:36.626 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:36.767 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":7,"num_osds":2,"num_up_osds":0,"osd_up_since":0,"num_in_osds":2,"osd_in_since":1770893974,"num_remapped_pgs":0} 2026-02-12T10:59:37.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:37 trial069 ceph-mon[25012]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:37.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:37 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1444582148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:37.769 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:37.793 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:37 trial031 ceph-mon[17813]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:37.793 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:37 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1444582148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:37.921 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:38.135 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:38.275 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":7,"num_osds":2,"num_up_osds":0,"osd_up_since":0,"num_in_osds":2,"osd_in_since":1770893974,"num_remapped_pgs":0} 2026-02-12T10:59:38.646 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:38 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1296935592' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:38.716 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:38 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1296935592' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:39.276 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:39.433 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:39.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2740738783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "432547cd-530c-495a-8f26-ed6802ac7af3"}]: dispatch 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2740738783' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "432547cd-530c-495a-8f26-ed6802ac7af3"}]': finished 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: osdmap e8: 3 total, 0 up, 3 in 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2019166624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dce023f-99bf-456f-a351-a7a2dc740073"}]: dispatch 2026-02-12T10:59:39.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dce023f-99bf-456f-a351-a7a2dc740073"}]: dispatch 2026-02-12T10:59:39.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1dce023f-99bf-456f-a351-a7a2dc740073"}]': finished 2026-02-12T10:59:39.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: osdmap e9: 4 total, 0 up, 4 in 2026-02-12T10:59:39.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:39.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:39.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:39.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:39.633 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:39 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2521411821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:39.642 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:39.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2740738783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "432547cd-530c-495a-8f26-ed6802ac7af3"}]: dispatch 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2740738783' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "432547cd-530c-495a-8f26-ed6802ac7af3"}]': finished 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: osdmap e8: 3 total, 0 up, 3 in 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/2019166624' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dce023f-99bf-456f-a351-a7a2dc740073"}]: dispatch 2026-02-12T10:59:39.730 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1dce023f-99bf-456f-a351-a7a2dc740073"}]: dispatch 2026-02-12T10:59:39.731 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1dce023f-99bf-456f-a351-a7a2dc740073"}]': finished 2026-02-12T10:59:39.731 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: osdmap e9: 4 total, 0 up, 4 in 2026-02-12T10:59:39.731 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:39.731 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:39.731 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:39.731 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:39.731 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:39 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2521411821' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:39.781 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":9,"num_osds":4,"num_up_osds":0,"osd_up_since":0,"num_in_osds":4,"osd_in_since":1770893978,"num_remapped_pgs":0} 2026-02-12T10:59:40.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:40 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/639796494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:40.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:40 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1334212230' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:40.782 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:40.805 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:40 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/639796494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:40.805 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:40 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1334212230' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:40.932 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:41.157 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:41.295 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":9,"num_osds":4,"num_up_osds":0,"osd_up_since":0,"num_in_osds":4,"osd_in_since":1770893978,"num_remapped_pgs":0} 2026-02-12T10:59:41.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:41 trial031 ceph-mon[17813]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:41.632 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:41 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3063083255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:41.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:41 trial069 ceph-mon[25012]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:41.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:41 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3063083255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:42.296 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:42.459 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:42.664 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:42 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T10:59:42.682 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:42.683 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:42 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T10:59:42.822 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":10,"num_osds":5,"num_up_osds":0,"osd_up_since":0,"num_in_osds":5,"osd_in_since":1770893982,"num_remapped_pgs":0} 2026-02-12T10:59:43.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:43.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/3888864651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bec04b4-8b55-42dd-9d3f-707e3711c23e"}]: dispatch 2026-02-12T10:59:43.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bec04b4-8b55-42dd-9d3f-707e3711c23e"}]: dispatch 2026-02-12T10:59:43.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0bec04b4-8b55-42dd-9d3f-707e3711c23e"}]': finished 2026-02-12T10:59:43.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: osdmap e10: 5 total, 0 up, 5 in 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1960543753' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3198222095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b786d6-2d51-428c-b043-060fc6af0ede"}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3198222095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20b786d6-2d51-428c-b043-060fc6af0ede"}]': finished 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: osdmap e11: 6 total, 0 up, 6 in 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:43.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:43.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:43.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:43.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:59:43.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/177792882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:43.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:43 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3859274762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:43.823 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:43.849 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/3888864651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bec04b4-8b55-42dd-9d3f-707e3711c23e"}]: dispatch 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0bec04b4-8b55-42dd-9d3f-707e3711c23e"}]: dispatch 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0bec04b4-8b55-42dd-9d3f-707e3711c23e"}]': finished 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: osdmap e10: 5 total, 0 up, 5 in 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:43.850 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1960543753' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3198222095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b786d6-2d51-428c-b043-060fc6af0ede"}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3198222095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20b786d6-2d51-428c-b043-060fc6af0ede"}]': finished 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: osdmap e11: 6 total, 0 up, 6 in 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/177792882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:43.851 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:43 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3859274762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:43.979 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:44.198 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:44.336 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":11,"num_osds":6,"num_up_osds":0,"osd_up_since":0,"num_in_osds":6,"osd_in_since":1770893982,"num_remapped_pgs":0} 2026-02-12T10:59:44.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:44 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1710856151' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:44.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:44 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1710856151' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:45.337 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:45.490 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:45.631 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:45 trial031 ceph-mon[17813]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:45.706 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:45.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:45 trial069 ceph-mon[25012]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:45.843 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":11,"num_osds":6,"num_up_osds":0,"osd_up_since":0,"num_in_osds":6,"osd_in_since":1770893982,"num_remapped_pgs":0} 2026-02-12T10:59:46.696 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:46 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1765280952' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:46.845 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:46.869 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:46 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1765280952' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:47.004 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:47.232 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:47.370 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:47.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:47.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/3156490169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a82a12-0ff6-4c04-9d44-bac90920bb60"}]: dispatch 2026-02-12T10:59:47.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a82a12-0ff6-4c04-9d44-bac90920bb60"}]: dispatch 2026-02-12T10:59:47.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7a82a12-0ff6-4c04-9d44-bac90920bb60"}]': finished 2026-02-12T10:59:47.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: osdmap e12: 7 total, 0 up, 7 in 2026-02-12T10:59:47.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:47.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/3106759527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2620691732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85d07d9b-b2a9-46ea-b788-fc6c08d77ced"}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2620691732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85d07d9b-b2a9-46ea-b788-fc6c08d77ced"}]': finished 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: osdmap e13: 8 total, 0 up, 8 in 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:47.718 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:47.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:47.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:47.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:59:47.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T10:59:47.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T10:59:47.719 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:47 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2748282098' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/3156490169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a82a12-0ff6-4c04-9d44-bac90920bb60"}]: dispatch 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7a82a12-0ff6-4c04-9d44-bac90920bb60"}]: dispatch 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7a82a12-0ff6-4c04-9d44-bac90920bb60"}]': finished 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: osdmap e12: 7 total, 0 up, 7 in 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:47.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/3106759527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2620691732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85d07d9b-b2a9-46ea-b788-fc6c08d77ced"}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2620691732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85d07d9b-b2a9-46ea-b788-fc6c08d77ced"}]': finished 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: osdmap e13: 8 total, 0 up, 8 in 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:59:47.883 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:59:47.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:59:47.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T10:59:47.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T10:59:47.884 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:47 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2748282098' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:48.371 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:48.531 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:48.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:48 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3786154599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:48.741 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:48.742 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:48 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3786154599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:59:48.881 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:49.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:49 trial069 ceph-mon[25012]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:49.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:49 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3195892435' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:49.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:49 trial031 ceph-mon[17813]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:49.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:49 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3195892435' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:49.882 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:50.036 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:50.247 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:50.384 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:50.582 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:50 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3912032397' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:50.685 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:50 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3912032397' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:51.386 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:51.509 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:51 trial031 ceph-mon[17813]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:51.510 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:51 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-12T10:59:51.510 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:51 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:51.524 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:51 trial069 ceph-mon[25012]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:51.525 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:51 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-12T10:59:51.525 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:51 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:51.558 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:51.780 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:51.922 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:52.599 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:52 trial031 ceph-mon[17813]: Deploying daemon osd.0 on trial069 2026-02-12T10:59:52.599 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:52 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1086506765' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:52.599 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:52 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-12T10:59:52.600 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:52 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:52.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:52 trial069 ceph-mon[25012]: Deploying daemon osd.0 on trial069 2026-02-12T10:59:52.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:52 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1086506765' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:52.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:52 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-12T10:59:52.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:52 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:52.923 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:53.082 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:53.305 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:53.446 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:53.690 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:53 trial069 ceph-mon[25012]: Deploying daemon osd.1 on trial031 2026-02-12T10:59:53.690 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:53 trial069 ceph-mon[25012]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:53.690 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:53 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/70526206' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:53.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:53 trial031 ceph-mon[17813]: Deploying daemon osd.1 on trial031 2026-02-12T10:59:53.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:53 trial031 ceph-mon[17813]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:53.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:53 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/70526206' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:54.447 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:54.633 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:54.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-12T10:59:54.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:54.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: Deploying daemon osd.3 on trial069 2026-02-12T10:59:54.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:54.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-12T10:59:54.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:54 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:54.865 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:54.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-12T10:59:54.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:54.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: Deploying daemon osd.3 on trial069 2026-02-12T10:59:54.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:54.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:54.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-12T10:59:54.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:54 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:55.005 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:55.884 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:55 trial069 ceph-mon[25012]: Deploying daemon osd.2 on trial031 2026-02-12T10:59:55.884 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:55 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2364493944' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:56.006 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:56.029 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:55 trial031 ceph-mon[17813]: Deploying daemon osd.2 on trial031 2026-02-12T10:59:56.029 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:55 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2364493944' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:56.166 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:56.403 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:56.547 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:56.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:56 trial031 ceph-mon[17813]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:56.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:56 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2364000061' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:56.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:56 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:56.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:56 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:56.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:56 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-12T10:59:56.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:56 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:56.978 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:56 trial069 ceph-mon[25012]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:56.978 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:56 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2364000061' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:56.978 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:56 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:56.978 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:56 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:56.978 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:56 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-12T10:59:56.978 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:56 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:57.549 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:57.748 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:57.947 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:57 trial031 ceph-mon[17813]: Deploying daemon osd.4 on trial069 2026-02-12T10:59:57.948 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:57 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T10:59:57.948 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:57 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:57.948 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:57 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:57.949 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:57 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-12T10:59:57.949 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:57 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:57.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:57 trial069 ceph-mon[25012]: Deploying daemon osd.4 on trial069 2026-02-12T10:59:57.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:57 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T10:59:57.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:57 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:57.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:57 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:57.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:57 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-12T10:59:57.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:57 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:57.968 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:58.107 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:58.881 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:58 trial031 ceph-mon[17813]: Deploying daemon osd.5 on trial031 2026-02-12T10:59:58.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:58 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2101644130' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:58.882 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:58 trial031 ceph-mon[17813]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:58.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:58 trial069 ceph-mon[25012]: Deploying daemon osd.5 on trial031 2026-02-12T10:59:58.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:58 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2101644130' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:58.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:58 trial069 ceph-mon[25012]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:59:59.108 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:59:59.277 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T10:59:59.495 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T10:59:59.655 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T10:59:59.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: from='osd.0 [v2:10.20.193.69:6800/3391319242,v1:10.20.193.69:6801/3391319242]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-12T10:59:59.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-12T10:59:59.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:59.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:59.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-12T10:59:59.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:59.807 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: Deploying daemon osd.6 on trial069 2026-02-12T10:59:59.808 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 10:59:59 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1413013006' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: from='osd.0 [v2:10.20.193.69:6800/3391319242,v1:10.20.193.69:6801/3391319242]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: Deploying daemon osd.6 on trial069 2026-02-12T10:59:59.916 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 10:59:59 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1413013006' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:00.657 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:00.813 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:00.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-12T11:00:00.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: osdmap e14: 8 total, 0 up, 8 in 2026-02-12T11:00:00.836 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='osd.0 [v2:10.20.193.69:6800/3391319242,v1:10.20.193.69:6801/3391319242]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-12T11:00:00.837 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: overall HEALTH_OK 2026-02-12T11:00:00.838 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T11:00:00.838 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:00.838 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:00.838 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-12T11:00:00.838 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T11:00:00.838 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:00 trial031 ceph-mon[17813]: Deploying daemon osd.7 on trial031 2026-02-12T11:00:01.029 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:01.167 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":15,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: osdmap e14: 8 total, 0 up, 8 in 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='osd.0 [v2:10.20.193.69:6800/3391319242,v1:10.20.193.69:6801/3391319242]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: overall HEALTH_OK 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:01.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:01.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-12T11:00:01.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T11:00:01.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:00 trial069 ceph-mon[25012]: Deploying daemon osd.7 on trial031 2026-02-12T11:00:01.823 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:01.823 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-12T11:00:01.823 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: osdmap e15: 8 total, 0 up, 8 in 2026-02-12T11:00:01.823 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:01.823 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/4249272232' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: osd.0 [v2:10.20.193.69:6800/3391319242,v1:10.20.193.69:6801/3391319242] boot 2026-02-12T11:00:01.824 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:01 trial069 ceph-mon[25012]: osdmap e16: 8 total, 1 up, 8 in 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: osdmap e15: 8 total, 0 up, 8 in 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:02.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/4249272232' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: from='osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: osd.0 [v2:10.20.193.69:6800/3391319242,v1:10.20.193.69:6801/3391319242] boot 2026-02-12T11:00:02.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:01 trial031 ceph-mon[17813]: osdmap e16: 8 total, 1 up, 8 in 2026-02-12T11:00:02.169 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:02.329 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:02.548 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:02.705 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":16,"num_osds":8,"num_up_osds":1,"osd_up_since":1770894001,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T11:00:02.960 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: OSD bench result of 126843.490439 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:02.961 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:02.962 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:02.962 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='osd.3 [v2:10.20.193.69:6808/2676211811,v1:10.20.193.69:6809/2676211811]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T11:00:02.962 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T11:00:02.962 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T11:00:02.962 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:02.962 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:02.962 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:02 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3163721076' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:02.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:02.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:02.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: OSD bench result of 126843.490439 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:02.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T11:00:02.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='osd.3 [v2:10.20.193.69:6808/2676211811,v1:10.20.193.69:6809/2676211811]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T11:00:02.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:02.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:02.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:02 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3163721076' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:03.706 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:03.869 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: OSD bench result of 109365.587724 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783] boot 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: osdmap e17: 8 total, 2 up, 8 in 2026-02-12T11:00:03.911 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='osd.3 [v2:10.20.193.69:6808/2676211811,v1:10.20.193.69:6809/2676211811]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:03.912 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:03.913 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:03.913 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:03 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: OSD bench result of 109365.587724 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: osd.1 [v2:10.20.193.31:6802/987349783,v1:10.20.193.31:6803/987349783] boot 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: osdmap e17: 8 total, 2 up, 8 in 2026-02-12T11:00:03.984 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='osd.3 [v2:10.20.193.69:6808/2676211811,v1:10.20.193.69:6809/2676211811]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:03.985 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:03.986 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:03 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:04.114 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:04.262 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":18,"num_osds":8,"num_up_osds":2,"osd_up_since":1770894002,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T11:00:04.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:04.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-12T11:00:04.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: osdmap e18: 8 total, 2 up, 8 in 2026-02-12T11:00:04.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2745372114' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='osd.4 [v2:10.20.193.69:6816/3569481396,v1:10.20.193.69:6817/3569481396]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T11:00:04.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:04 trial069 ceph-mon[25012]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T11:00:05.114 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:05.114 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-12T11:00:05.114 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: osdmap e18: 8 total, 2 up, 8 in 2026-02-12T11:00:05.114 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:05.114 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:05.114 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:05.114 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2745372114' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='osd.4 [v2:10.20.193.69:6816/3569481396,v1:10.20.193.69:6817/3569481396]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T11:00:05.115 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:04 trial031 ceph-mon[17813]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T11:00:05.263 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:05.422 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:05.663 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:05.804 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":19,"num_osds":8,"num_up_osds":3,"osd_up_since":1770894004,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T11:00:05.945 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:05.946 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:05.946 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: OSD bench result of 138523.258032 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:05.946 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:05.946 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-12T11:00:05.946 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='osd.4 [v2:10.20.193.69:6816/3569481396,v1:10.20.193.69:6817/3569481396]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:05.946 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: osd.3 [v2:10.20.193.69:6808/2676211811,v1:10.20.193.69:6809/2676211811] boot 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: osdmap e19: 8 total, 3 up, 8 in 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:05.947 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1138288628' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:05.948 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:05 trial069 ceph-mon[25012]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:06.118 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:06.118 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:06.118 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: OSD bench result of 138523.258032 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:06.118 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:06.118 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='osd.4 [v2:10.20.193.69:6816/3569481396,v1:10.20.193.69:6817/3569481396]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: osd.3 [v2:10.20.193.69:6808/2676211811,v1:10.20.193.69:6809/2676211811] boot 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: osdmap e19: 8 total, 3 up, 8 in 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:06.119 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.120 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.120 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T11:00:06.120 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.120 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.120 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1138288628' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:06.120 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:05 trial031 ceph-mon[17813]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:06.806 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:06.966 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:06.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:06.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:06.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640] boot 2026-02-12T11:00:06.967 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: osdmap e20: 8 total, 4 up, 8 in 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T11:00:06.968 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: pgmap v35: 0 pgs: ; 0 B data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:06.969 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:06 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: osd.2 [v2:10.20.193.31:6810/4280466640,v1:10.20.193.31:6811/4280466640] boot 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: osdmap e20: 8 total, 4 up, 8 in 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:07.022 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: pgmap v35: 0 pgs: ; 0 B data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:07.023 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:07.024 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:06 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:07.188 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:07.328 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":21,"num_osds":8,"num_up_osds":5,"osd_up_since":1770894006,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T11:00:08.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:08.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:08.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: OSD bench result of 122637.205177 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:08.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: Detected new or changed devices on trial069 2026-02-12T11:00:08.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: Adjusting osd_memory_target on trial069 to 20467M 2026-02-12T11:00:08.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:08.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: osd.4 [v2:10.20.193.69:6816/3569481396,v1:10.20.193.69:6817/3569481396] boot 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: osdmap e21: 8 total, 5 up, 8 in 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3398894011' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:08.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: Detected new or changed devices on trial031 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: Adjusting osd_memory_target on trial031 to 19699M 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T11:00:08.135 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='osd.6 [v2:10.20.193.69:6824/1013408938,v1:10.20.193.69:6825/1013408938]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-12T11:00:08.135 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:07 trial031 ceph-mon[17813]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-12T11:00:08.150 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:08.150 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:08.150 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: OSD bench result of 122637.205177 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: Detected new or changed devices on trial069 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: Adjusting osd_memory_target on trial069 to 20467M 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: osd.4 [v2:10.20.193.69:6816/3569481396,v1:10.20.193.69:6817/3569481396] boot 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: osdmap e21: 8 total, 5 up, 8 in 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:08.151 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3398894011' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: Detected new or changed devices on trial031 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-12T11:00:08.152 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: Adjusting osd_memory_target on trial031 to 19699M 2026-02-12T11:00:08.153 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.153 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T11:00:08.153 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T11:00:08.153 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:08.153 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T11:00:08.153 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='osd.6 [v2:10.20.193.69:6824/1013408938,v1:10.20.193.69:6825/1013408938]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-12T11:00:08.153 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:07 trial069 ceph-mon[25012]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-12T11:00:08.329 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:08.489 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58132]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58132]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58132]: pam_unix(sudo:session): session closed for user root 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58136]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58136]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T11:00:08.512 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 sudo[58136]: pam_unix(sudo:session): session closed for user root 2026-02-12T11:00:08.706 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41341]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41341]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41341]: pam_unix(sudo:session): session closed for user root 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41345]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41345]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T11:00:08.717 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 sudo[41345]: pam_unix(sudo:session): session closed for user root 2026-02-12T11:00:08.847 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":22,"num_osds":8,"num_up_osds":5,"osd_up_since":1770894006,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: osdmap e22: 8 total, 5 up, 8 in 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:09.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='osd.6 [v2:10.20.193.69:6824/1013408938,v1:10.20.193.69:6825/1013408938]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: pgmap v38: 1 pgs: 1 unknown; 0 B data, 132 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T11:00:09.133 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3124791044' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:09.134 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:08 trial031 ceph-mon[17813]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-12T11:00:09.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:09.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-12T11:00:09.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-12T11:00:09.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: osdmap e22: 8 total, 5 up, 8 in 2026-02-12T11:00:09.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:09.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='osd.6 [v2:10.20.193.69:6824/1013408938,v1:10.20.193.69:6825/1013408938]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial069", "root=default"]}]: dispatch 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: pgmap v38: 1 pgs: 1 unknown; 0 B data, 132 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial031"}]: dispatch 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "mon metadata", "id": "trial069"}]: dispatch 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3124791044' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:09.219 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:08 trial069 ceph-mon[25012]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-12T11:00:09.849 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:10.007 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:10.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304] boot 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: osdmap e23: 8 total, 6 up, 8 in 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:10.132 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:09 trial031 ceph-mon[17813]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:10.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:10.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:10.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial069", "root=default"]}]': finished 2026-02-12T11:00:10.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-12T11:00:10.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: osd.5 [v2:10.20.193.31:6818/4232739304,v1:10.20.193.31:6819/4232739304] boot 2026-02-12T11:00:10.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: osdmap e23: 8 total, 6 up, 8 in 2026-02-12T11:00:10.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial031", "root=default"]}]: dispatch 2026-02-12T11:00:10.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T11:00:10.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:10.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:10.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:10.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:09 trial069 ceph-mon[25012]: from='osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial031", "root=default"]}]': finished 2026-02-12T11:00:10.220 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:10.361 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":24,"num_osds":8,"num_up_osds":7,"osd_up_since":1770894009,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":0} 2026-02-12T11:00:11.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:11.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:11.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: OSD bench result of 146225.303460 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.6. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: osd.6 [v2:10.20.193.69:6824/1013408938,v1:10.20.193.69:6825/1013408938] boot 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: osdmap e24: 8 total, 7 up, 8 in 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3030749223' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905] boot 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: osdmap e25: 8 total, 8 up, 8 in 2026-02-12T11:00:11.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:10 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:11.362 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T11:00:11.381 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:11.381 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: OSD bench result of 146225.303460 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.6. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: osd.6 [v2:10.20.193.69:6824/1013408938,v1:10.20.193.69:6825/1013408938] boot 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: osdmap e24: 8 total, 7 up, 8 in 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3030749223' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: osd.7 [v2:10.20.193.31:6826/525642905,v1:10.20.193.31:6827/525642905] boot 2026-02-12T11:00:11.382 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: osdmap e25: 8 total, 8 up, 8 in 2026-02-12T11:00:11.383 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:10 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-12T11:00:11.519 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:11.731 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:11.869 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":26,"num_osds":8,"num_up_osds":8,"osd_up_since":1770894010,"num_in_osds":8,"osd_in_since":1770893987,"num_remapped_pgs":1} 2026-02-12T11:00:11.870 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd dump --format=json 2026-02-12T11:00:12.065 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:12.087 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:11 trial031 ceph-mon[17813]: purged_snaps scrub starts 2026-02-12T11:00:12.087 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:11 trial031 ceph-mon[17813]: purged_snaps scrub ok 2026-02-12T11:00:12.087 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:11 trial031 ceph-mon[17813]: mgrmap e19: trial031.nmnrzg(active, since 58s), standbys: trial069.azktyl 2026-02-12T11:00:12.087 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:11 trial031 ceph-mon[17813]: osdmap e26: 8 total, 8 up, 8 in 2026-02-12T11:00:12.088 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:11 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3470680641' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:12.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:11 trial069 ceph-mon[25012]: purged_snaps scrub starts 2026-02-12T11:00:12.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:11 trial069 ceph-mon[25012]: purged_snaps scrub ok 2026-02-12T11:00:12.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:11 trial069 ceph-mon[25012]: mgrmap e19: trial031.nmnrzg(active, since 58s), standbys: trial069.azktyl 2026-02-12T11:00:12.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:11 trial069 ceph-mon[25012]: osdmap e26: 8 total, 8 up, 8 in 2026-02-12T11:00:12.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:11 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3470680641' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T11:00:12.276 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:12.276 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":26,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","created":"2026-02-12T10:58:29.166977+0000","modified":"2026-02-12T11:00:11.635079+0000","last_up_change":"2026-02-12T11:00:10.633510+0000","last_in_change":"2026-02-12T10:59:47.090515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":13,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T11:00:06.088805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f8ba8df9-1916-4316-a03c-1edeac15d66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6800","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6801","nonce":3391319242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6802","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6803","nonce":3391319242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6806","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6807","nonce":3391319242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6804","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6805","nonce":3391319242}]},"public_addr":"10.20.193.69:6801/3391319242","cluster_addr":"10.20.193.69:6803/3391319242","heartbeat_back_addr":"10.20.193.69:6807/3391319242","heartbeat_front_addr":"10.20.193.69:6805/3391319242","state":["exists","up"]},{"osd":1,"uuid":"c4f06536-725e-43f0-b148-3f6df879dd07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6802","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6803","nonce":987349783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6804","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6805","nonce":987349783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6808","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6809","nonce":987349783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6806","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6807","nonce":987349783}]},"public_addr":"10.20.193.31:6803/987349783","cluster_addr":"10.20.193.31:6805/987349783","heartbeat_back_addr":"10.20.193.31:6809/987349783","heartbeat_front_addr":"10.20.193.31:6807/987349783","state":["exists","up"]},{"osd":2,"uuid":"432547cd-530c-495a-8f26-ed6802ac7af3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6810","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6811","nonce":4280466640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6812","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6813","nonce":4280466640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6816","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6817","nonce":4280466640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6814","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6815","nonce":4280466640}]},"public_addr":"10.20.193.31:6811/4280466640","cluster_addr":"10.20.193.31:6813/4280466640","heartbeat_back_addr":"10.20.193.31:6817/4280466640","heartbeat_front_addr":"10.20.193.31:6815/4280466640","state":["exists","up"]},{"osd":3,"uuid":"1dce023f-99bf-456f-a351-a7a2dc740073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6808","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6809","nonce":2676211811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6810","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6811","nonce":2676211811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6814","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6815","nonce":2676211811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6812","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6813","nonce":2676211811}]},"public_addr":"10.20.193.69:6809/2676211811","cluster_addr":"10.20.193.69:6811/2676211811","heartbeat_back_addr":"10.20.193.69:6815/2676211811","heartbeat_front_addr":"10.20.193.69:6813/2676211811","state":["exists","up"]},{"osd":4,"uuid":"0bec04b4-8b55-42dd-9d3f-707e3711c23e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6816","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6817","nonce":3569481396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6818","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6819","nonce":3569481396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6822","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6823","nonce":3569481396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6820","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6821","nonce":3569481396}]},"public_addr":"10.20.193.69:6817/3569481396","cluster_addr":"10.20.193.69:6819/3569481396","heartbeat_back_addr":"10.20.193.69:6823/3569481396","heartbeat_front_addr":"10.20.193.69:6821/3569481396","state":["exists","up"]},{"osd":5,"uuid":"20b786d6-2d51-428c-b043-060fc6af0ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6818","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6819","nonce":4232739304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6820","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6821","nonce":4232739304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6824","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6825","nonce":4232739304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6822","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6823","nonce":4232739304}]},"public_addr":"10.20.193.31:6819/4232739304","cluster_addr":"10.20.193.31:6821/4232739304","heartbeat_back_addr":"10.20.193.31:6825/4232739304","heartbeat_front_addr":"10.20.193.31:6823/4232739304","state":["exists","up"]},{"osd":6,"uuid":"f7a82a12-0ff6-4c04-9d44-bac90920bb60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6824","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6825","nonce":1013408938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6826","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6827","nonce":1013408938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6830","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6831","nonce":1013408938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6828","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6829","nonce":1013408938}]},"public_addr":"10.20.193.69:6825/1013408938","cluster_addr":"10.20.193.69:6827/1013408938","heartbeat_back_addr":"10.20.193.69:6831/1013408938","heartbeat_front_addr":"10.20.193.69:6829/1013408938","state":["exists","up"]},{"osd":7,"uuid":"85d07d9b-b2a9-46ea-b788-fc6c08d77ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6826","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6827","nonce":525642905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6828","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6829","nonce":525642905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6832","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6833","nonce":525642905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6830","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6831","nonce":525642905}]},"public_addr":"10.20.193.31:6827/525642905","cluster_addr":"10.20.193.31:6829/525642905","heartbeat_back_addr":"10.20.193.31:6833/525642905","heartbeat_front_addr":"10.20.193.31:6831/525642905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,2]}],"primary_temp":[],"blocklist":{"10.20.193.31:0/2612681891":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6800/175970098":"2026-02-13T10:58:39.497606+0000","10.20.193.31:6801/175970098":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3380782820":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3856808249":"2026-02-13T10:59:12.049656+0000","10.20.193.31:0/1589393633":"2026-02-13T10:59:12.049656+0000","10.20.193.31:0/326482738":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6800/3349612423":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6801/3349612423":"2026-02-13T10:58:50.756585+0000","10.20.193.31:0/552322346":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/2955337061":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3327693566":"2026-02-13T10:58:50.756585+0000","10.20.193.31:0/3577911288":"2026-02-13T10:59:12.049656+0000","10.20.193.31:6800/2775101969":"2026-02-13T10:59:12.049656+0000","10.20.193.31:6801/2775101969":"2026-02-13T10:59:12.049656+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T11:00:12.415 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-12T11:00:06.088805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-12T11:00:12.415 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-12T11:00:12.567 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:12.781 INFO:teuthology.orchestra.run.trial031.stdout:pg_num: 1 2026-02-12T11:00:12.918 INFO:tasks.cephadm:Setting up client nodes... 2026-02-12T11:00:12.918 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-12T11:00:13.070 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:13.186 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:12 trial031 ceph-mon[17813]: pgmap v44: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-12T11:00:13.186 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:12 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T11:00:13.186 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:12 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2829863505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T11:00:13.186 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:12 trial031 ceph-mon[17813]: osdmap e27: 8 total, 8 up, 8 in 2026-02-12T11:00:13.186 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:12 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2988671211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-12T11:00:13.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:12 trial069 ceph-mon[25012]: pgmap v44: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-12T11:00:13.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:12 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-12T11:00:13.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:12 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2829863505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T11:00:13.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:12 trial069 ceph-mon[25012]: osdmap e27: 8 total, 8 up, 8 in 2026-02-12T11:00:13.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:12 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2988671211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-12T11:00:13.312 INFO:teuthology.orchestra.run.trial031.stdout:[client.0] 2026-02-12T11:00:13.312 INFO:teuthology.orchestra.run.trial031.stdout: key = AQC9so1p57SLEhAA89ZF7TFWLLiDqEotUJrR9Q== 2026-02-12T11:00:13.452 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T11:00:13.453 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-12T11:00:13.453 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T11:00:13.488 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-12T11:00:13.646 INFO:teuthology.orchestra.run.trial069.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial069/config 2026-02-12T11:00:13.902 INFO:teuthology.orchestra.run.trial069.stdout:[client.1] 2026-02-12T11:00:13.902 INFO:teuthology.orchestra.run.trial069.stdout: key = AQC9so1poAqdNRAA3WARpyX4+TmLDU54VxXPGg== 2026-02-12T11:00:14.043 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T11:00:14.043 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-12T11:00:14.043 DEBUG:teuthology.orchestra.run.trial069:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-12T11:00:14.077 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T11:00:14.077 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-12T11:00:14.077 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-12T11:00:14.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:13 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/4093184590' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-12T11:00:14.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:13 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/4093184590' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-12T11:00:14.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:13 trial069 ceph-mon[25012]: osdmap e28: 8 total, 8 up, 8 in 2026-02-12T11:00:14.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:13 trial069 ceph-mon[25012]: from='client.? 10.20.193.69:0/2517344469' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-12T11:00:14.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:13 trial069 ceph-mon[25012]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-12T11:00:14.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:13 trial069 ceph-mon[25012]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-12T11:00:14.230 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:14.253 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:13 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/4093184590' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-12T11:00:14.253 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:13 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/4093184590' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-12T11:00:14.253 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:13 trial031 ceph-mon[17813]: osdmap e28: 8 total, 8 up, 8 in 2026-02-12T11:00:14.253 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:13 trial031 ceph-mon[17813]: from='client.? 10.20.193.69:0/2517344469' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-12T11:00:14.253 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:13 trial031 ceph-mon[17813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-12T11:00:14.253 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:13 trial031 ceph-mon[17813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-12T11:00:14.473 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:14.609 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":19,"flags":0,"active_gid":14207,"active_name":"trial031.nmnrzg","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6800","nonce":3892923435},{"type":"v1","addr":"10.20.193.31:6801","nonce":3892923435}]},"active_addr":"10.20.193.31:6801/3892923435","active_change":"2026-02-12T10:59:12.049756+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14228,"name":"trial069.azktyl","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.31:8443/","prometheus":"http://10.20.193.31:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.31:0","nonce":4043313325}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.31:0","nonce":2176433932}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.31:0","nonce":409501007}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.31:0","nonce":3106945443}]}]} 2026-02-12T11:00:14.616 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-12T11:00:14.616 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-12T11:00:14.617 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd dump --format=json 2026-02-12T11:00:14.772 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:14.986 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:14.986 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":29,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","created":"2026-02-12T10:58:29.166977+0000","modified":"2026-02-12T11:00:14.638339+0000","last_up_change":"2026-02-12T11:00:10.633510+0000","last_in_change":"2026-02-12T10:59:47.090515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":13,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T11:00:06.088805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f8ba8df9-1916-4316-a03c-1edeac15d66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6800","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6801","nonce":3391319242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6802","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6803","nonce":3391319242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6806","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6807","nonce":3391319242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6804","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6805","nonce":3391319242}]},"public_addr":"10.20.193.69:6801/3391319242","cluster_addr":"10.20.193.69:6803/3391319242","heartbeat_back_addr":"10.20.193.69:6807/3391319242","heartbeat_front_addr":"10.20.193.69:6805/3391319242","state":["exists","up"]},{"osd":1,"uuid":"c4f06536-725e-43f0-b148-3f6df879dd07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6802","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6803","nonce":987349783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6804","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6805","nonce":987349783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6808","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6809","nonce":987349783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6806","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6807","nonce":987349783}]},"public_addr":"10.20.193.31:6803/987349783","cluster_addr":"10.20.193.31:6805/987349783","heartbeat_back_addr":"10.20.193.31:6809/987349783","heartbeat_front_addr":"10.20.193.31:6807/987349783","state":["exists","up"]},{"osd":2,"uuid":"432547cd-530c-495a-8f26-ed6802ac7af3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6810","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6811","nonce":4280466640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6812","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6813","nonce":4280466640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6816","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6817","nonce":4280466640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6814","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6815","nonce":4280466640}]},"public_addr":"10.20.193.31:6811/4280466640","cluster_addr":"10.20.193.31:6813/4280466640","heartbeat_back_addr":"10.20.193.31:6817/4280466640","heartbeat_front_addr":"10.20.193.31:6815/4280466640","state":["exists","up"]},{"osd":3,"uuid":"1dce023f-99bf-456f-a351-a7a2dc740073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6808","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6809","nonce":2676211811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6810","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6811","nonce":2676211811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6814","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6815","nonce":2676211811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6812","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6813","nonce":2676211811}]},"public_addr":"10.20.193.69:6809/2676211811","cluster_addr":"10.20.193.69:6811/2676211811","heartbeat_back_addr":"10.20.193.69:6815/2676211811","heartbeat_front_addr":"10.20.193.69:6813/2676211811","state":["exists","up"]},{"osd":4,"uuid":"0bec04b4-8b55-42dd-9d3f-707e3711c23e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6816","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6817","nonce":3569481396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6818","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6819","nonce":3569481396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6822","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6823","nonce":3569481396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6820","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6821","nonce":3569481396}]},"public_addr":"10.20.193.69:6817/3569481396","cluster_addr":"10.20.193.69:6819/3569481396","heartbeat_back_addr":"10.20.193.69:6823/3569481396","heartbeat_front_addr":"10.20.193.69:6821/3569481396","state":["exists","up"]},{"osd":5,"uuid":"20b786d6-2d51-428c-b043-060fc6af0ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6818","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6819","nonce":4232739304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6820","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6821","nonce":4232739304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6824","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6825","nonce":4232739304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6822","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6823","nonce":4232739304}]},"public_addr":"10.20.193.31:6819/4232739304","cluster_addr":"10.20.193.31:6821/4232739304","heartbeat_back_addr":"10.20.193.31:6825/4232739304","heartbeat_front_addr":"10.20.193.31:6823/4232739304","state":["exists","up"]},{"osd":6,"uuid":"f7a82a12-0ff6-4c04-9d44-bac90920bb60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6824","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6825","nonce":1013408938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6826","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6827","nonce":1013408938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6830","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6831","nonce":1013408938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6828","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6829","nonce":1013408938}]},"public_addr":"10.20.193.69:6825/1013408938","cluster_addr":"10.20.193.69:6827/1013408938","heartbeat_back_addr":"10.20.193.69:6831/1013408938","heartbeat_front_addr":"10.20.193.69:6829/1013408938","state":["exists","up"]},{"osd":7,"uuid":"85d07d9b-b2a9-46ea-b788-fc6c08d77ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6826","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6827","nonce":525642905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6828","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6829","nonce":525642905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6832","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6833","nonce":525642905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6830","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6831","nonce":525642905}]},"public_addr":"10.20.193.31:6827/525642905","cluster_addr":"10.20.193.31:6829/525642905","heartbeat_back_addr":"10.20.193.31:6833/525642905","heartbeat_front_addr":"10.20.193.31:6831/525642905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.31:0/2612681891":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6800/175970098":"2026-02-13T10:58:39.497606+0000","10.20.193.31:6801/175970098":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3380782820":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3856808249":"2026-02-13T10:59:12.049656+0000","10.20.193.31:0/1589393633":"2026-02-13T10:59:12.049656+0000","10.20.193.31:0/326482738":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6800/3349612423":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6801/3349612423":"2026-02-13T10:58:50.756585+0000","10.20.193.31:0/552322346":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/2955337061":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3327693566":"2026-02-13T10:58:50.756585+0000","10.20.193.31:0/3577911288":"2026-02-13T10:59:12.049656+0000","10.20.193.31:6800/2775101969":"2026-02-13T10:59:12.049656+0000","10.20.193.31:6801/2775101969":"2026-02-13T10:59:12.049656+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T11:00:15.105 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:14 trial031 ceph-mon[17813]: pgmap v47: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-12T11:00:15.105 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:14 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/494301251' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-12T11:00:15.105 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:14 trial031 ceph-mon[17813]: osdmap e29: 8 total, 8 up, 8 in 2026-02-12T11:00:15.128 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-12T11:00:15.128 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd dump --format=json 2026-02-12T11:00:15.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:14 trial069 ceph-mon[25012]: pgmap v47: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-12T11:00:15.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:14 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/494301251' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-12T11:00:15.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:14 trial069 ceph-mon[25012]: osdmap e29: 8 total, 8 up, 8 in 2026-02-12T11:00:15.279 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.488 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:15.489 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":29,"fsid":"bbe50c82-0801-11f1-9f0b-d404e6e7d460","created":"2026-02-12T10:58:29.166977+0000","modified":"2026-02-12T11:00:14.638339+0000","last_up_change":"2026-02-12T11:00:10.633510+0000","last_in_change":"2026-02-12T10:59:47.090515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":13,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T11:00:06.088805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f8ba8df9-1916-4316-a03c-1edeac15d66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6800","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6801","nonce":3391319242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6802","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6803","nonce":3391319242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6806","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6807","nonce":3391319242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6804","nonce":3391319242},{"type":"v1","addr":"10.20.193.69:6805","nonce":3391319242}]},"public_addr":"10.20.193.69:6801/3391319242","cluster_addr":"10.20.193.69:6803/3391319242","heartbeat_back_addr":"10.20.193.69:6807/3391319242","heartbeat_front_addr":"10.20.193.69:6805/3391319242","state":["exists","up"]},{"osd":1,"uuid":"c4f06536-725e-43f0-b148-3f6df879dd07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6802","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6803","nonce":987349783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6804","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6805","nonce":987349783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6808","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6809","nonce":987349783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6806","nonce":987349783},{"type":"v1","addr":"10.20.193.31:6807","nonce":987349783}]},"public_addr":"10.20.193.31:6803/987349783","cluster_addr":"10.20.193.31:6805/987349783","heartbeat_back_addr":"10.20.193.31:6809/987349783","heartbeat_front_addr":"10.20.193.31:6807/987349783","state":["exists","up"]},{"osd":2,"uuid":"432547cd-530c-495a-8f26-ed6802ac7af3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6810","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6811","nonce":4280466640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6812","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6813","nonce":4280466640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6816","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6817","nonce":4280466640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6814","nonce":4280466640},{"type":"v1","addr":"10.20.193.31:6815","nonce":4280466640}]},"public_addr":"10.20.193.31:6811/4280466640","cluster_addr":"10.20.193.31:6813/4280466640","heartbeat_back_addr":"10.20.193.31:6817/4280466640","heartbeat_front_addr":"10.20.193.31:6815/4280466640","state":["exists","up"]},{"osd":3,"uuid":"1dce023f-99bf-456f-a351-a7a2dc740073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6808","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6809","nonce":2676211811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6810","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6811","nonce":2676211811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6814","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6815","nonce":2676211811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6812","nonce":2676211811},{"type":"v1","addr":"10.20.193.69:6813","nonce":2676211811}]},"public_addr":"10.20.193.69:6809/2676211811","cluster_addr":"10.20.193.69:6811/2676211811","heartbeat_back_addr":"10.20.193.69:6815/2676211811","heartbeat_front_addr":"10.20.193.69:6813/2676211811","state":["exists","up"]},{"osd":4,"uuid":"0bec04b4-8b55-42dd-9d3f-707e3711c23e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6816","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6817","nonce":3569481396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6818","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6819","nonce":3569481396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6822","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6823","nonce":3569481396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6820","nonce":3569481396},{"type":"v1","addr":"10.20.193.69:6821","nonce":3569481396}]},"public_addr":"10.20.193.69:6817/3569481396","cluster_addr":"10.20.193.69:6819/3569481396","heartbeat_back_addr":"10.20.193.69:6823/3569481396","heartbeat_front_addr":"10.20.193.69:6821/3569481396","state":["exists","up"]},{"osd":5,"uuid":"20b786d6-2d51-428c-b043-060fc6af0ede","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6818","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6819","nonce":4232739304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6820","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6821","nonce":4232739304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6824","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6825","nonce":4232739304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6822","nonce":4232739304},{"type":"v1","addr":"10.20.193.31:6823","nonce":4232739304}]},"public_addr":"10.20.193.31:6819/4232739304","cluster_addr":"10.20.193.31:6821/4232739304","heartbeat_back_addr":"10.20.193.31:6825/4232739304","heartbeat_front_addr":"10.20.193.31:6823/4232739304","state":["exists","up"]},{"osd":6,"uuid":"f7a82a12-0ff6-4c04-9d44-bac90920bb60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6824","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6825","nonce":1013408938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6826","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6827","nonce":1013408938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6830","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6831","nonce":1013408938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.69:6828","nonce":1013408938},{"type":"v1","addr":"10.20.193.69:6829","nonce":1013408938}]},"public_addr":"10.20.193.69:6825/1013408938","cluster_addr":"10.20.193.69:6827/1013408938","heartbeat_back_addr":"10.20.193.69:6831/1013408938","heartbeat_front_addr":"10.20.193.69:6829/1013408938","state":["exists","up"]},{"osd":7,"uuid":"85d07d9b-b2a9-46ea-b788-fc6c08d77ced","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6826","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6827","nonce":525642905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6828","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6829","nonce":525642905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6832","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6833","nonce":525642905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.31:6830","nonce":525642905},{"type":"v1","addr":"10.20.193.31:6831","nonce":525642905}]},"public_addr":"10.20.193.31:6827/525642905","cluster_addr":"10.20.193.31:6829/525642905","heartbeat_back_addr":"10.20.193.31:6833/525642905","heartbeat_front_addr":"10.20.193.31:6831/525642905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.31:0/2612681891":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6800/175970098":"2026-02-13T10:58:39.497606+0000","10.20.193.31:6801/175970098":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3380782820":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3856808249":"2026-02-13T10:59:12.049656+0000","10.20.193.31:0/1589393633":"2026-02-13T10:59:12.049656+0000","10.20.193.31:0/326482738":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6800/3349612423":"2026-02-13T10:58:50.756585+0000","10.20.193.31:6801/3349612423":"2026-02-13T10:58:50.756585+0000","10.20.193.31:0/552322346":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/2955337061":"2026-02-13T10:58:39.497606+0000","10.20.193.31:0/3327693566":"2026-02-13T10:58:50.756585+0000","10.20.193.31:0/3577911288":"2026-02-13T10:59:12.049656+0000","10.20.193.31:6800/2775101969":"2026-02-13T10:59:12.049656+0000","10.20.193.31:6801/2775101969":"2026-02-13T10:59:12.049656+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T11:00:15.627 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-12T11:00:15.628 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-12T11:00:15.629 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-12T11:00:15.629 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-12T11:00:15.630 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-12T11:00:15.630 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-12T11:00:15.630 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-12T11:00:15.631 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-12T11:00:15.846 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.849 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.849 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.908 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.908 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.909 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.956 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:15.968 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:15 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3421908824' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T11:00:16.131 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:15 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/4173452543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T11:00:16.164 INFO:teuthology.orchestra.run.trial031.stdout:68719476740 2026-02-12T11:00:16.164 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-12T11:00:16.166 INFO:teuthology.orchestra.run.trial031.stdout:103079215108 2026-02-12T11:00:16.167 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-12T11:00:16.168 INFO:teuthology.orchestra.run.trial031.stdout:98784247812 2026-02-12T11:00:16.168 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-12T11:00:16.196 INFO:teuthology.orchestra.run.trial031.stdout:81604378629 2026-02-12T11:00:16.197 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-12T11:00:16.199 INFO:teuthology.orchestra.run.trial031.stdout:73014444038 2026-02-12T11:00:16.200 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-12T11:00:16.203 INFO:teuthology.orchestra.run.trial031.stdout:90194313221 2026-02-12T11:00:16.204 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-12T11:00:16.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:15 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3421908824' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T11:00:16.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:15 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/4173452543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T11:00:16.236 INFO:teuthology.orchestra.run.trial031.stdout:85899345925 2026-02-12T11:00:16.237 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-12T11:00:16.250 INFO:teuthology.orchestra.run.trial031.stdout:107374182404 2026-02-12T11:00:16.251 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-12T11:00:16.397 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.399 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.399 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.401 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.405 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.437 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.538 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.542 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:16.651 INFO:teuthology.orchestra.run.trial031.stdout:68719476739 2026-02-12T11:00:16.652 INFO:teuthology.orchestra.run.trial031.stdout:103079215106 2026-02-12T11:00:16.656 INFO:teuthology.orchestra.run.trial031.stdout:73014444037 2026-02-12T11:00:16.657 INFO:teuthology.orchestra.run.trial031.stdout:98784247811 2026-02-12T11:00:16.659 INFO:teuthology.orchestra.run.trial031.stdout:81604378627 2026-02-12T11:00:16.668 INFO:teuthology.orchestra.run.trial031.stdout:90194313220 2026-02-12T11:00:16.786 INFO:teuthology.orchestra.run.trial031.stdout:85899345923 2026-02-12T11:00:16.792 INFO:teuthology.orchestra.run.trial031.stdout:107374182402 2026-02-12T11:00:16.796 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476740 got 68719476739 for osd.0 2026-02-12T11:00:16.803 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215108 got 103079215106 for osd.6 2026-02-12T11:00:16.813 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444038 got 73014444037 for osd.1 2026-02-12T11:00:16.814 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378629 got 81604378627 for osd.3 2026-02-12T11:00:16.823 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247812 got 98784247811 for osd.5 2026-02-12T11:00:16.826 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.4 2026-02-12T11:00:16.929 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345925 got 85899345923 for osd.2 2026-02-12T11:00:16.935 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182404 got 107374182402 for osd.7 2026-02-12T11:00:17.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 130 KiB/s, 0 objects/s recovering 2026-02-12T11:00:17.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3365676538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T11:00:17.217 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1272807455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-12T11:00:17.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3683122321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T11:00:17.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2016145111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T11:00:17.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2377395663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T11:00:17.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/717519740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T11:00:17.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3463891236' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T11:00:17.218 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:16 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/731837228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-12T11:00:17.270 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 130 KiB/s, 0 objects/s recovering 2026-02-12T11:00:17.270 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3365676538' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T11:00:17.271 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1272807455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-12T11:00:17.271 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3683122321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T11:00:17.271 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2016145111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T11:00:17.271 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2377395663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T11:00:17.271 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/717519740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T11:00:17.271 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3463891236' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T11:00:17.271 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:16 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/731837228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-12T11:00:17.797 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-12T11:00:17.805 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-12T11:00:17.813 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-12T11:00:17.815 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-12T11:00:17.824 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-12T11:00:17.827 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-12T11:00:17.930 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-12T11:00:17.990 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-12T11:00:17.991 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.019 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.082 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.082 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.083 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.085 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.191 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.217 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.230 INFO:teuthology.orchestra.run.trial031.stdout:68719476741 2026-02-12T11:00:18.249 INFO:teuthology.orchestra.run.trial031.stdout:73014444038 2026-02-12T11:00:18.318 INFO:teuthology.orchestra.run.trial031.stdout:90194313222 2026-02-12T11:00:18.321 INFO:teuthology.orchestra.run.trial031.stdout:103079215108 2026-02-12T11:00:18.327 INFO:teuthology.orchestra.run.trial031.stdout:81604378629 2026-02-12T11:00:18.333 INFO:teuthology.orchestra.run.trial031.stdout:98784247812 2026-02-12T11:00:18.374 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476740 got 68719476741 for osd.0 2026-02-12T11:00:18.374 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.1 2026-02-12T11:00:18.391 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.420 INFO:teuthology.orchestra.run.trial031.stdout:85899345925 2026-02-12T11:00:18.430 INFO:teuthology.orchestra.run.trial031.stdout:107374182404 2026-02-12T11:00:18.468 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313221 got 90194313222 for osd.4 2026-02-12T11:00:18.468 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.470 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378629 got 81604378629 for osd.3 2026-02-12T11:00:18.470 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.471 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215108 got 103079215108 for osd.6 2026-02-12T11:00:18.471 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.483 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247812 got 98784247812 for osd.5 2026-02-12T11:00:18.484 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.561 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345925 got 85899345925 for osd.2 2026-02-12T11:00:18.562 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.577 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182404 got 107374182404 for osd.7 2026-02-12T11:00:18.578 DEBUG:teuthology.parallel:result is None 2026-02-12T11:00:18.578 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-12T11:00:18.578 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph pg dump --format=json 2026-02-12T11:00:18.769 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:18.980 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:18.981 INFO:teuthology.orchestra.run.trial031.stderr:dumped all 2026-02-12T11:00:19.118 INFO:teuthology.orchestra.run.trial031.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2026-02-12T11:00:18.059829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5871992832,"kb_used":219740,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871773092,"statfs":{"total":6012920659968,"available":6012695646208,"internally_reserved":0,"allocated":4042752,"data_stored":2653888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":220712505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000727"},"pg_stats":[{"pgid":"1.0","version":"22'172","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-12T11:00:14.643645+0000","last_change":"2026-02-12T11:00:14.643462+0000","last_active":"2026-02-12T11:00:14.643645+0000","last_peered":"2026-02-12T11:00:14.643645+0000","last_clean":"2026-02-12T11:00:14.643645+0000","last_became_active":"2026-02-12T11:00:14.643284+0000","last_became_peered":"2026-02-12T11:00:14.643284+0000","last_unstale":"2026-02-12T11:00:14.643645+0000","last_undegraded":"2026-02-12T11:00:14.643645+0000","last_fullsized":"2026-02-12T11:00:14.643645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T11:00:06.931472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T11:00:06.931472+0000","last_clean_scrub_stamp":"2026-02-12T11:00:06.931472+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:02:17.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,2],"acting":[7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":25,"seq":107374182404,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":27832,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971272,"statfs":{"total":751615082496,"available":751586582528,"internally_reserved":0,"allocated":876544,"data_stored":700716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247812,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":27832,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971272,"statfs":{"total":751615082496,"available":751586582528,"internally_reserved":0,"allocated":876544,"data_stored":700716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27252,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971852,"statfs":{"total":751615082496,"available":751587176448,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":27832,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971272,"statfs":{"total":751615082496,"available":751586582528,"internally_reserved":0,"allocated":876544,"data_stored":700716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T11:00:19.119 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph pg dump --format=json 2026-02-12T11:00:19.274 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2894872852' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1955206099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3335469936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/556708792' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2530449328' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2578021016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T11:00:19.295 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/4206872224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T11:00:19.296 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:19 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/2723189404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-12T11:00:19.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-12T11:00:19.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2894872852' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T11:00:19.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1955206099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T11:00:19.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3335469936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T11:00:19.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/556708792' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-12T11:00:19.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2530449328' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T11:00:19.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2578021016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T11:00:19.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/4206872224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T11:00:19.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:19 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/2723189404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-12T11:00:19.477 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:19.478 INFO:teuthology.orchestra.run.trial031.stderr:dumped all 2026-02-12T11:00:19.614 INFO:teuthology.orchestra.run.trial031.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2026-02-12T11:00:18.059829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5871992832,"kb_used":219740,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871773092,"statfs":{"total":6012920659968,"available":6012695646208,"internally_reserved":0,"allocated":4042752,"data_stored":2653888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":220712505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000727"},"pg_stats":[{"pgid":"1.0","version":"22'172","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-12T11:00:14.643645+0000","last_change":"2026-02-12T11:00:14.643462+0000","last_active":"2026-02-12T11:00:14.643645+0000","last_peered":"2026-02-12T11:00:14.643645+0000","last_clean":"2026-02-12T11:00:14.643645+0000","last_became_active":"2026-02-12T11:00:14.643284+0000","last_became_peered":"2026-02-12T11:00:14.643284+0000","last_unstale":"2026-02-12T11:00:14.643645+0000","last_undegraded":"2026-02-12T11:00:14.643645+0000","last_fullsized":"2026-02-12T11:00:14.643645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T11:00:06.931472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T11:00:06.931472+0000","last_clean_scrub_stamp":"2026-02-12T11:00:06.931472+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:02:17.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,2],"acting":[7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":25,"seq":107374182404,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":27832,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971272,"statfs":{"total":751615082496,"available":751586582528,"internally_reserved":0,"allocated":876544,"data_stored":700716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247812,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":20,"seq":85899345925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":27832,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971272,"statfs":{"total":751615082496,"available":751586582528,"internally_reserved":0,"allocated":876544,"data_stored":700716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27248,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971856,"statfs":{"total":751615082496,"available":751587180544,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":733999104,"kb_used":27252,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971852,"statfs":{"total":751615082496,"available":751587176448,"internally_reserved":0,"allocated":282624,"data_stored":110348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":733999104,"kb_used":27832,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733971272,"statfs":{"total":751615082496,"available":751586582528,"internally_reserved":0,"allocated":876544,"data_stored":700716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T11:00:19.615 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-12T11:00:19.615 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T11:00:19.615 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-12T11:00:19.615 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph health --format=json 2026-02-12T11:00:19.768 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:19.997 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T11:00:19.997 INFO:teuthology.orchestra.run.trial031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T11:00:20.137 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-12T11:00:20.138 INFO:tasks.cephadm:Setup complete, yielding 2026-02-12T11:00:20.138 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-12T11:00:20.156 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial031.front.sepia.ceph.com 2026-02-12T11:00:20.156 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-12T11:00:20.311 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:20.381 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:20 trial031 ceph-mon[17813]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T11:00:20.381 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:20 trial031 ceph-mon[17813]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T11:00:20.381 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:20 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/835830974' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-12T11:00:20.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:20 trial069 ceph-mon[25012]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T11:00:20.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:20 trial069 ceph-mon[25012]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T11:00:20.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:20 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/835830974' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-12T11:00:20.527 INFO:teuthology.orchestra.run.trial031.stdout:Backend: cephadm 2026-02-12T11:00:20.527 INFO:teuthology.orchestra.run.trial031.stdout:Available: Yes 2026-02-12T11:00:20.527 INFO:teuthology.orchestra.run.trial031.stdout:Paused: No 2026-02-12T11:00:20.664 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-12T11:00:20.814 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:21.034 INFO:teuthology.orchestra.run.trial031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:alertmanager.trial031 trial031 *:9093,9094 running (52s) 15s ago 80s 33.5M - 0.25.0 c8568f914cd2 40ad9cb409a6 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:ceph-exporter.trial031 trial031 *:9926 running (84s) 15s ago 83s 8334k - 19.2.3-680-g05b55d19 dcf18b7f874c a23db9a80c72 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:ceph-exporter.trial069 trial069 *:9926 running (64s) 15s ago 64s 6585k - 19.2.3-680-g05b55d19 dcf18b7f874c 898733d8681a 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:crash.trial031 trial031 running (83s) 15s ago 83s 7666k - 19.2.3-680-g05b55d19 dcf18b7f874c 0a940ee0bea8 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:crash.trial069 trial069 running (64s) 15s ago 63s 7675k - 19.2.3-680-g05b55d19 dcf18b7f874c 741d8b19d43c 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:grafana.trial031 trial031 *:3000 running (51s) 15s ago 76s 80.5M - 10.4.0 c8b91775d855 781a3bc035f1 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:mgr.trial031.nmnrzg trial031 *:9283,8765,8443 running (109s) 15s ago 109s 538M - 19.2.3-680-g05b55d19 dcf18b7f874c 9e1380ce4aa1 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:mgr.trial069.azktyl trial069 *:8443,9283,8765 running (62s) 15s ago 62s 484M - 19.2.3-680-g05b55d19 dcf18b7f874c abadc5b2469f 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:mon.trial031 trial031 running (110s) 15s ago 111s 47.3M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c 07bc85666a44 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:mon.trial069 trial069 running (60s) 15s ago 60s 42.2M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c d7d4e5d2192f 2026-02-12T11:00:21.035 INFO:teuthology.orchestra.run.trial031.stdout:node-exporter.trial031 trial031 *:9100 running (81s) 15s ago 81s 12.9M - 1.7.0 72c9c2088986 047766ef9882 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:node-exporter.trial069 trial069 *:9100 running (62s) 15s ago 62s 11.5M - 1.7.0 72c9c2088986 f4829938c429 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.0 trial069 running (27s) 15s ago 27s 38.2M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 4176c19af189 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.1 trial031 running (26s) 15s ago 26s 39.2M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c dcf3de8dd4cb 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.2 trial031 running (23s) 15s ago 23s 32.7M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 3b27b5824cc8 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.3 trial069 running (24s) 15s ago 24s 40.6M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 05d25ef10915 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.4 trial069 running (21s) 15s ago 21s 26.8M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 203719b55bef 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.5 trial031 running (20s) 15s ago 20s 17.6M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 29066e8eab01 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.6 trial069 running (18s) 15s ago 18s 16.8M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c d4cd67a5d4d8 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:osd.7 trial031 running (17s) 15s ago 17s 15.4M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c ef98c383a0ea 2026-02-12T11:00:21.036 INFO:teuthology.orchestra.run.trial031.stdout:prometheus.trial031 trial031 *:9095 running (50s) 15s ago 72s 40.0M - 2.51.0 1d3b7f56885b 3af0d9c0eac9 2026-02-12T11:00:21.151 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:21 trial031 ceph-mon[17813]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 78 KiB/s, 0 objects/s recovering 2026-02-12T11:00:21.172 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-12T11:00:21.325 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:21.466 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:21 trial069 ceph-mon[25012]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 78 KiB/s, 0 objects/s recovering 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:alertmanager ?:9093,9094 1/1 15s ago 95s count:1 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:ceph-exporter ?:9926 2/2 16s ago 96s * 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:crash 2/2 16s ago 96s * 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:grafana ?:3000 1/1 15s ago 95s count:1 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:mgr 2/2 16s ago 97s count:2 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:mon 2/2 16s ago 81s trial031:10.20.193.31=trial031;trial069:10.20.193.69=trial069;count:2 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:node-exporter ?:9100 2/2 16s ago 95s * 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:osd.all-available-devices 8 16s ago 53s * 2026-02-12T11:00:21.544 INFO:teuthology.orchestra.run.trial031.stdout:prometheus ?:9095 1/1 15s ago 96s count:1 2026-02-12T11:00:21.684 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-12T11:00:21.836 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:22.052 INFO:teuthology.orchestra.run.trial031.stdout:HOST ADDR LABELS STATUS 2026-02-12T11:00:22.052 INFO:teuthology.orchestra.run.trial031.stdout:trial031 10.20.193.31 2026-02-12T11:00:22.052 INFO:teuthology.orchestra.run.trial031.stdout:trial069 10.20.193.69 2026-02-12T11:00:22.053 INFO:teuthology.orchestra.run.trial031.stdout:2 hosts in cluster 2026-02-12T11:00:22.169 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:22 trial031 ceph-mon[17813]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:22.169 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:22 trial031 ceph-mon[17813]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:22.189 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-12T11:00:22.342 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:22.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:22 trial069 ceph-mon[25012]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:22.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:22 trial069 ceph-mon[25012]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:22.566 INFO:teuthology.orchestra.run.trial031.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-12T11:00:22.566 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB5195 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB516F 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme3n1 ssd Linux_1db8ee2ede80f7558983 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme4n1 ssd Linux_0c512f06da0d2341fc64 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme5n1 ssd Linux_2625cf15164416c7779e 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme6n1 ssd Linux_f7a57b9dcb1a714196ff 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00426 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00440 1788G No 15s ago Has a FileSystem, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme3n1 ssd Linux_9c68a612098e2f89cc0d 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme4n1 ssd Linux_5cd7e615781dd0ced459 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.567 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme5n1 ssd Linux_2afc4f58391b1c7b232e 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.568 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme6n1 ssd Linux_6eece110976ab60a8a9e 700G No 15s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:22.706 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- bash -c 'ceph orch ls | grep '"'"'^osd.all-available-devices '"'"'' 2026-02-12T11:00:22.860 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:23.085 INFO:teuthology.orchestra.run.trial031.stdout:osd.all-available-devices 8 17s ago 54s * 2026-02-12T11:00:23.197 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:23 trial031 ceph-mon[17813]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:23.197 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:23 trial031 ceph-mon[17813]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:23.198 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:23 trial031 ceph-mon[17813]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 68 KiB/s, 0 objects/s recovering 2026-02-12T11:00:23.219 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-12T11:00:23.237 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial031.front.sepia.ceph.com 2026-02-12T11:00:23.237 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- bash -c 'set -e 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> set -x 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> ceph orch ps 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> ceph orch device ls 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> ceph osd tree 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> for osd in `ceph osd ls` ; do 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> ceph orch osd rm $osd --force --zap --replace 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> done 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> while ceph orch osd rm ls | wc | grep ^1 ; do sleep 10 ; done 2026-02-12T11:00:23.238 DEBUG:teuthology.orchestra.run.trial031:> ' 2026-02-12T11:00:23.390 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:23.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:23 trial069 ceph-mon[25012]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:23.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:23 trial069 ceph-mon[25012]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:23.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:23 trial069 ceph-mon[25012]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 68 KiB/s, 0 objects/s recovering 2026-02-12T11:00:23.474 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch ps 2026-02-12T11:00:23.615 INFO:teuthology.orchestra.run.trial031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-12T11:00:23.615 INFO:teuthology.orchestra.run.trial031.stdout:alertmanager.trial031 trial031 *:9093,9094 running (55s) 17s ago 82s 33.5M - 0.25.0 c8568f914cd2 40ad9cb409a6 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:ceph-exporter.trial031 trial031 *:9926 running (86s) 17s ago 86s 8334k - 19.2.3-680-g05b55d19 dcf18b7f874c a23db9a80c72 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:ceph-exporter.trial069 trial069 *:9926 running (67s) 18s ago 67s 6585k - 19.2.3-680-g05b55d19 dcf18b7f874c 898733d8681a 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:crash.trial031 trial031 running (85s) 17s ago 85s 7666k - 19.2.3-680-g05b55d19 dcf18b7f874c 0a940ee0bea8 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:crash.trial069 trial069 running (66s) 18s ago 66s 7675k - 19.2.3-680-g05b55d19 dcf18b7f874c 741d8b19d43c 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:grafana.trial031 trial031 *:3000 running (54s) 17s ago 78s 80.5M - 10.4.0 c8b91775d855 781a3bc035f1 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:mgr.trial031.nmnrzg trial031 *:9283,8765,8443 running (112s) 17s ago 112s 538M - 19.2.3-680-g05b55d19 dcf18b7f874c 9e1380ce4aa1 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:mgr.trial069.azktyl trial069 *:8443,9283,8765 running (64s) 18s ago 64s 484M - 19.2.3-680-g05b55d19 dcf18b7f874c abadc5b2469f 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:mon.trial031 trial031 running (113s) 17s ago 114s 47.3M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c 07bc85666a44 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:mon.trial069 trial069 running (63s) 18s ago 63s 42.2M 2048M 19.2.3-680-g05b55d19 dcf18b7f874c d7d4e5d2192f 2026-02-12T11:00:23.616 INFO:teuthology.orchestra.run.trial031.stdout:node-exporter.trial031 trial031 *:9100 running (84s) 17s ago 84s 12.9M - 1.7.0 72c9c2088986 047766ef9882 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:node-exporter.trial069 trial069 *:9100 running (65s) 18s ago 65s 11.5M - 1.7.0 72c9c2088986 f4829938c429 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.0 trial069 running (29s) 18s ago 29s 38.2M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 4176c19af189 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.1 trial031 running (29s) 17s ago 28s 39.2M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c dcf3de8dd4cb 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.2 trial031 running (26s) 17s ago 26s 32.7M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 3b27b5824cc8 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.3 trial069 running (27s) 18s ago 27s 40.6M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 05d25ef10915 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.4 trial069 running (24s) 18s ago 24s 26.8M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c 203719b55bef 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.5 trial031 running (23s) 17s ago 23s 17.6M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c 29066e8eab01 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.6 trial069 running (21s) 18s ago 21s 16.8M 19.9G 19.2.3-680-g05b55d19 dcf18b7f874c d4cd67a5d4d8 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:osd.7 trial031 running (20s) 17s ago 20s 15.4M 19.2G 19.2.3-680-g05b55d19 dcf18b7f874c ef98c383a0ea 2026-02-12T11:00:23.617 INFO:teuthology.orchestra.run.trial031.stdout:prometheus.trial031 trial031 *:9095 running (52s) 17s ago 75s 40.0M - 2.51.0 1d3b7f56885b 3af0d9c0eac9 2026-02-12T11:00:23.622 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch device ls 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB5195 1788G No 16s ago Has a FileSystem, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB516F 1788G No 16s ago Has a FileSystem, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme3n1 ssd Linux_1db8ee2ede80f7558983 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme4n1 ssd Linux_0c512f06da0d2341fc64 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme5n1 ssd Linux_2625cf15164416c7779e 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial031 /dev/nvme6n1 ssd Linux_f7a57b9dcb1a714196ff 700G No 16s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00426 1788G No 17s ago Has a FileSystem, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00440 1788G No 17s ago Has a FileSystem, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme3n1 ssd Linux_9c68a612098e2f89cc0d 700G No 17s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme4n1 ssd Linux_5cd7e615781dd0ced459 700G No 17s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme5n1 ssd Linux_2afc4f58391b1c7b232e 700G No 17s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.757 INFO:teuthology.orchestra.run.trial031.stdout:trial069 /dev/nvme6n1 ssd Linux_6eece110976ab60a8a9e 700G No 17s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2026-02-12T11:00:23.764 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph osd tree 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout:-1 5.46875 root default 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout:-5 2.73438 host trial031 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout: 1 ssd 0.68359 osd.1 up 1.00000 1.00000 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout: 2 ssd 0.68359 osd.2 up 1.00000 1.00000 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout: 5 ssd 0.68359 osd.5 up 1.00000 1.00000 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout: 7 ssd 0.68359 osd.7 up 1.00000 1.00000 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout:-3 2.73438 host trial069 2026-02-12T11:00:23.894 INFO:teuthology.orchestra.run.trial031.stdout: 0 ssd 0.68359 osd.0 up 1.00000 1.00000 2026-02-12T11:00:23.895 INFO:teuthology.orchestra.run.trial031.stdout: 3 ssd 0.68359 osd.3 up 1.00000 1.00000 2026-02-12T11:00:23.895 INFO:teuthology.orchestra.run.trial031.stdout: 4 ssd 0.68359 osd.4 up 1.00000 1.00000 2026-02-12T11:00:23.895 INFO:teuthology.orchestra.run.trial031.stdout: 6 ssd 0.68359 osd.6 up 1.00000 1.00000 2026-02-12T11:00:23.900 INFO:teuthology.orchestra.run.trial031.stderr:++ ceph osd ls 2026-02-12T11:00:24.040 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:24.040 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 0 --force --zap --replace 2026-02-12T11:00:24.182 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:24.189 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:24.189 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 1 --force --zap --replace 2026-02-12T11:00:24.330 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:24.331 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:24 trial031 ceph-mon[17813]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:24.331 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:24 trial031 ceph-mon[17813]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:24.331 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:24 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/1617803748' entity='client.admin' cmd=[{"prefix": "osd tree"}]: dispatch 2026-02-12T11:00:24.331 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:24 trial031 ceph-mon[17813]: from='client.? 10.20.193.31:0/3055452883' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2026-02-12T11:00:24.339 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:24.339 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 2 --force --zap --replace 2026-02-12T11:00:24.432 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:24 trial069 ceph-mon[25012]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:24.432 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:24 trial069 ceph-mon[25012]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:24.432 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:24 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/1617803748' entity='client.admin' cmd=[{"prefix": "osd tree"}]: dispatch 2026-02-12T11:00:24.432 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:24 trial069 ceph-mon[25012]: from='client.? 10.20.193.31:0/3055452883' entity='client.admin' cmd=[{"prefix": "osd ls"}]: dispatch 2026-02-12T11:00:24.481 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:24.489 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:24.490 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 3 --force --zap --replace 2026-02-12T11:00:24.632 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:24.640 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:24.640 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 4 --force --zap --replace 2026-02-12T11:00:24.787 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:24.796 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:24.796 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 5 --force --zap --replace 2026-02-12T11:00:24.937 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:24.946 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:24.947 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 6 --force --zap --replace 2026-02-12T11:00:25.093 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:25.101 INFO:teuthology.orchestra.run.trial031.stderr:+ for osd in `ceph osd ls` 2026-02-12T11:00:25.101 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm 7 --force --zap --replace 2026-02-12T11:00:25.241 INFO:teuthology.orchestra.run.trial031.stdout:Scheduled OSD(s) for removal. 2026-02-12T11:00:25.241 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 58 KiB/s, 0 objects/s recovering 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["0"], "force": true, "zap": true, "replace": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: osd.0 crush weight is 0.68359375 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["1"], "force": true, "zap": true, "replace": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: osd.1 crush weight is 0.68359375 2026-02-12T11:00:25.242 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["2"], "force": true, "zap": true, "replace": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: osd.2 crush weight is 0.68359375 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.243 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-mon[17813]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.249 INFO:teuthology.orchestra.run.trial031.stderr:+ ceph orch osd rm ls 2026-02-12T11:00:25.249 INFO:teuthology.orchestra.run.trial031.stderr:+ wc 2026-02-12T11:00:25.249 INFO:teuthology.orchestra.run.trial031.stderr:+ grep '^1' 2026-02-12T11:00:25.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail; 58 KiB/s, 0 objects/s recovering 2026-02-12T11:00:25.467 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["0"], "force": true, "zap": true, "replace": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: osd.0 crush weight is 0.68359375 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["1"], "force": true, "zap": true, "replace": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: osd.1 crush weight is 0.68359375 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch osd rm", "osd_id": ["2"], "force": true, "zap": true, "replace": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: osd.2 crush weight is 0.68359375 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.468 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.469 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:25.469 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' 2026-02-12T11:00:25.469 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.469 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:25 trial069 ceph-mon[25012]: from='mgr.14207 10.20.193.31:0/2077341207' entity='mgr.trial031.nmnrzg' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T11:00:25.507 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031[17783]: 2026-02-12T11:00:25.451+0000 7fb29e13b640 -1 mon.trial031@0(leader).osd e29 definitely_dead 0 2026-02-12T11:00:25.528 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-12T11:00:25.542 INFO:tasks.cephadm:Teardown begin 2026-02-12T11:00:25.543 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T11:00:25.569 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T11:00:25.597 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-12T11:00:25.597 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-12T11:00:25.762 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/mon.trial031/config 2026-02-12T11:00:25.780 INFO:teuthology.orchestra.run.trial031.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-12T11:00:25.797 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-12T11:00:25.797 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-12T11:00:25.798 DEBUG:teuthology.orchestra.run.trial031:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-12T11:00:25.816 DEBUG:teuthology.orchestra.run.trial069:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-12T11:00:25.834 INFO:tasks.cephadm:Stopping all daemons... 2026-02-12T11:00:25.835 INFO:tasks.cephadm.mon.trial031:Stopping mon.trial031... 2026-02-12T11:00:25.835 DEBUG:teuthology.orchestra.run.trial031:> sudo systemctl stop ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031 2026-02-12T11:00:26.113 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 systemd[1]: Stopping Ceph mon.trial031 for bbe50c82-0801-11f1-9f0b-d404e6e7d460... 2026-02-12T11:00:26.113 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031[17783]: 2026-02-12T11:00:25.962+0000 7fb2a3946640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial031 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T11:00:26.113 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Feb 12 11:00:25 trial031 ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial031[17783]: 2026-02-12T11:00:25.962+0000 7fb2a3946640 -1 mon.trial031@0(leader) e2 *** Got Signal Terminated *** 2026-02-12T11:00:26.311 DEBUG:teuthology.orchestra.run.trial031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial031.service' 2026-02-12T11:00:26.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T11:00:26.354 INFO:tasks.cephadm.mon.trial031:Stopped mon.trial031 2026-02-12T11:00:26.354 INFO:tasks.cephadm.mon.trial069:Stopping mon.trial069... 2026-02-12T11:00:26.355 DEBUG:teuthology.orchestra.run.trial069:> sudo systemctl stop ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial069 2026-02-12T11:00:26.688 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:26 trial069 systemd[1]: Stopping Ceph mon.trial069 for bbe50c82-0801-11f1-9f0b-d404e6e7d460... 2026-02-12T11:00:26.689 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:26 trial069 ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial069[24986]: 2026-02-12T11:00:26.454+0000 7fddd574d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial069 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T11:00:26.689 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:26 trial069 ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial069[24986]: 2026-02-12T11:00:26.454+0000 7fddd574d640 -1 mon.trial069@1(peon) e2 *** Got Signal Terminated *** 2026-02-12T11:00:26.689 INFO:journalctl@ceph.mon.trial069.trial069.stdout:Feb 12 11:00:26 trial069 podman[42194]: 2026-02-12 11:00:26.687584695 +0000 UTC m=+0.247223105 container died d7d4e5d2192fcbd5cb33048cf96fc30b8a343507b560eaee594cdea1a4056f95 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460-mon-trial069, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-12T11:00:26.886 DEBUG:teuthology.orchestra.run.trial069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bbe50c82-0801-11f1-9f0b-d404e6e7d460@mon.trial069.service' 2026-02-12T11:00:26.923 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T11:00:26.924 INFO:tasks.cephadm.mon.trial069:Stopped mon.trial069 2026-02-12T11:00:26.924 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 --force --keep-logs 2026-02-12T11:00:27.037 INFO:teuthology.orchestra.run.trial031.stdout:Deleting cluster with fsid: bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T11:00:55.369 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 --force --keep-logs 2026-02-12T11:00:55.485 INFO:teuthology.orchestra.run.trial069.stdout:Deleting cluster with fsid: bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T11:01:22.727 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T11:01:22.756 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T11:01:22.783 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-12T11:01:22.790 DEBUG:teuthology.misc:Transferring archived files from trial031:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340/remote/trial031/crash 2026-02-12T11:01:22.794 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/crash -- . 2026-02-12T11:01:22.823 INFO:teuthology.orchestra.run.trial031.stderr:tar: /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-12T11:01:22.823 INFO:teuthology.orchestra.run.trial031.stderr:tar: Error is not recoverable: exiting now 2026-02-12T11:01:22.828 DEBUG:teuthology.misc:Transferring archived files from trial069:/var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340/remote/trial069/crash 2026-02-12T11:01:22.829 DEBUG:teuthology.orchestra.run.trial069:> sudo tar c -f - -C /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/crash -- . 2026-02-12T11:01:22.857 INFO:teuthology.orchestra.run.trial069.stderr:tar: /var/lib/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-12T11:01:22.857 INFO:teuthology.orchestra.run.trial069.stderr:tar: Error is not recoverable: exiting now 2026-02-12T11:01:22.858 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-12T11:01:22.858 DEBUG:teuthology.orchestra.run.trial031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v OSD_DOWN | egrep -v CEPHADM_FAILED_DAEMON | egrep -v 'but it is still running' | egrep -v PG_DEGRADED | head -n 1 2026-02-12T11:01:22.896 INFO:tasks.cephadm:Compressing logs... 2026-02-12T11:01:22.896 DEBUG:teuthology.orchestra.run.trial031:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T11:01:22.938 DEBUG:teuthology.orchestra.run.trial069:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T11:01:22.959 INFO:teuthology.orchestra.run.trial031.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-12T11:01:22.961 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-12T11:01:22.961 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.2.log 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mgr.trial031.nmnrzg.log 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mon.trial031.log 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mgr.trial031.nmnrzg.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.5.log 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mon.trial031.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.7.log 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.cephadm.log 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.5.log: /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.audit.log 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-volume.log/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.cephadm.log: 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.audit.log: 83.9%gzip -5 -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.cephadm.log.gz --verbose 2026-02-12T11:01:22.962 INFO:teuthology.orchestra.run.trial031.stderr: -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.1.log 2026-02-12T11:01:22.965 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-client.ceph-exporter.trial031.log 2026-02-12T11:01:22.965 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-volume.log: /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.log 2026-02-12T11:01:22.965 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-client.ceph-exporter.trial031.log: 90.2% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-client.ceph-exporter.trial031.log.gz 2026-02-12T11:01:22.965 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.log: 90.9% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.audit.log.gz 2026-02-12T11:01:22.966 INFO:teuthology.orchestra.run.trial031.stderr: 83.6% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.log.gz 2026-02-12T11:01:22.968 INFO:teuthology.orchestra.run.trial069.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-12T11:01:22.968 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-12T11:01:22.968 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.0.log 2026-02-12T11:01:22.968 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.3.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mgr.trial069.azktyl.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.0.log: /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-client.ceph-exporter.trial069.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mgr.trial069.azktyl.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.cephadm.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-client.ceph-exporter.trial069.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.4.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr: 30.2% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-client.ceph-exporter.trial069.log.gz 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.audit.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.cephadm.log.gz 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-volume.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.6.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mon.trial069.log 2026-02-12T11:01:22.969 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.log 2026-02-12T11:01:22.970 INFO:teuthology.orchestra.run.trial069.stderr: 90.9% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.audit.log.gz 2026-02-12T11:01:22.970 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mon.trial069.log: 90.9% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mgr.trial069.azktyl.log.gz 2026-02-12T11:01:22.970 INFO:teuthology.orchestra.run.trial069.stderr:/var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.log: 82.3% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph.log.gz 2026-02-12T11:01:22.970 INFO:teuthology.orchestra.run.trial031.stderr: 93.3% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.5.log.gz 2026-02-12T11:01:22.970 INFO:teuthology.orchestra.run.trial031.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T11:01:22.971 INFO:teuthology.orchestra.run.trial031.stderr: 95.9% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-volume.log.gz 2026-02-12T11:01:22.972 INFO:teuthology.orchestra.run.trial031.stderr: 93.1% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.7.log.gz 2026-02-12T11:01:22.973 INFO:teuthology.orchestra.run.trial069.stderr: 95.9% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-volume.log.gz 2026-02-12T11:01:22.973 INFO:teuthology.orchestra.run.trial069.stderr: 93.2% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.3.log.gz 2026-02-12T11:01:22.974 INFO:teuthology.orchestra.run.trial069.stderr: 93.2% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.4.log.gz 2026-02-12T11:01:22.976 INFO:teuthology.orchestra.run.trial069.stderr: 93.4% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.6.log.gz 2026-02-12T11:01:22.977 INFO:teuthology.orchestra.run.trial031.stderr: 94.1% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.2.log.gz 2026-02-12T11:01:22.981 INFO:teuthology.orchestra.run.trial069.stderr: 94.1% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.0.log.gz 2026-02-12T11:01:22.982 INFO:teuthology.orchestra.run.trial069.stderr: 92.4% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mon.trial069.log.gz 2026-02-12T11:01:22.983 INFO:teuthology.orchestra.run.trial069.stderr: 2026-02-12T11:01:22.984 INFO:teuthology.orchestra.run.trial069.stderr:real 0m0.030s 2026-02-12T11:01:22.984 INFO:teuthology.orchestra.run.trial069.stderr:user 0m0.082s 2026-02-12T11:01:22.984 INFO:teuthology.orchestra.run.trial069.stderr:sys 0m0.024s 2026-02-12T11:01:22.998 INFO:teuthology.orchestra.run.trial031.stderr: 94.3% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-osd.1.log.gz 2026-02-12T11:01:23.004 INFO:teuthology.orchestra.run.trial031.stderr: 89.9% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mgr.trial031.nmnrzg.log.gz 2026-02-12T11:01:23.034 INFO:teuthology.orchestra.run.trial031.stderr: 91.8% -- replaced with /var/log/ceph/bbe50c82-0801-11f1-9f0b-d404e6e7d460/ceph-mon.trial031.log.gz 2026-02-12T11:01:23.035 INFO:teuthology.orchestra.run.trial031.stderr: 2026-02-12T11:01:23.035 INFO:teuthology.orchestra.run.trial031.stderr:real 0m0.084s 2026-02-12T11:01:23.035 INFO:teuthology.orchestra.run.trial031.stderr:user 0m0.206s 2026-02-12T11:01:23.035 INFO:teuthology.orchestra.run.trial031.stderr:sys 0m0.030s 2026-02-12T11:01:23.036 INFO:tasks.cephadm:Archiving logs... 2026-02-12T11:01:23.037 DEBUG:teuthology.misc:Transferring archived files from trial031:/var/log/ceph to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340/remote/trial031/log 2026-02-12T11:01:23.038 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T11:01:23.172 DEBUG:teuthology.misc:Transferring archived files from trial069:/var/log/ceph to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340/remote/trial069/log 2026-02-12T11:01:23.173 DEBUG:teuthology.orchestra.run.trial069:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T11:01:23.227 INFO:tasks.cephadm:Removing cluster... 2026-02-12T11:01:23.227 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 --force 2026-02-12T11:01:23.341 INFO:teuthology.orchestra.run.trial031.stdout:Deleting cluster with fsid: bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T11:01:23.427 DEBUG:teuthology.orchestra.run.trial069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bbe50c82-0801-11f1-9f0b-d404e6e7d460 --force 2026-02-12T11:01:23.543 INFO:teuthology.orchestra.run.trial069.stdout:Deleting cluster with fsid: bbe50c82-0801-11f1-9f0b-d404e6e7d460 2026-02-12T11:01:23.631 INFO:tasks.cephadm:Removing cephadm ... 2026-02-12T11:01:23.631 DEBUG:teuthology.orchestra.run.trial031:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-12T11:01:23.649 DEBUG:teuthology.orchestra.run.trial069:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-12T11:01:23.666 INFO:tasks.cephadm:Teardown complete 2026-02-12T11:01:23.667 DEBUG:teuthology.run_tasks:Unwinding manager nvme_loop 2026-02-12T11:01:23.686 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial031:/dev/vg_nvme/lv_1... 2026-02-12T11:01:23.686 DEBUG:teuthology.orchestra.run.trial031:> sudo nvme disconnect -n lv_1 2026-02-12T11:01:23.928 INFO:teuthology.orchestra.run.trial031.stdout:NQN:lv_1 disconnected 1 controller(s) 2026-02-12T11:01:23.929 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial031:/dev/vg_nvme/lv_2... 2026-02-12T11:01:23.930 DEBUG:teuthology.orchestra.run.trial031:> sudo nvme disconnect -n lv_2 2026-02-12T11:01:24.203 INFO:teuthology.orchestra.run.trial031.stdout:NQN:lv_2 disconnected 1 controller(s) 2026-02-12T11:01:24.205 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial031:/dev/vg_nvme/lv_3... 2026-02-12T11:01:24.206 DEBUG:teuthology.orchestra.run.trial031:> sudo nvme disconnect -n lv_3 2026-02-12T11:01:24.464 INFO:teuthology.orchestra.run.trial031.stdout:NQN:lv_3 disconnected 1 controller(s) 2026-02-12T11:01:24.466 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial031:/dev/vg_nvme/lv_4... 2026-02-12T11:01:24.467 DEBUG:teuthology.orchestra.run.trial031:> sudo nvme disconnect -n lv_4 2026-02-12T11:01:24.715 INFO:teuthology.orchestra.run.trial031.stdout:NQN:lv_4 disconnected 1 controller(s) 2026-02-12T11:01:24.717 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-12T11:01:24.718 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/scratch_devs 2026-02-12T11:01:24.741 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial069:/dev/vg_nvme/lv_1... 2026-02-12T11:01:24.741 DEBUG:teuthology.orchestra.run.trial069:> sudo nvme disconnect -n lv_1 2026-02-12T11:01:25.024 INFO:teuthology.orchestra.run.trial069.stdout:NQN:lv_1 disconnected 1 controller(s) 2026-02-12T11:01:25.027 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial069:/dev/vg_nvme/lv_2... 2026-02-12T11:01:25.027 DEBUG:teuthology.orchestra.run.trial069:> sudo nvme disconnect -n lv_2 2026-02-12T11:01:25.271 INFO:teuthology.orchestra.run.trial069.stdout:NQN:lv_2 disconnected 1 controller(s) 2026-02-12T11:01:25.272 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial069:/dev/vg_nvme/lv_3... 2026-02-12T11:01:25.272 DEBUG:teuthology.orchestra.run.trial069:> sudo nvme disconnect -n lv_3 2026-02-12T11:01:25.525 INFO:teuthology.orchestra.run.trial069.stdout:NQN:lv_3 disconnected 1 controller(s) 2026-02-12T11:01:25.526 INFO:tasks.nvme_loop:Disconnecting nvme_loop trial069:/dev/vg_nvme/lv_4... 2026-02-12T11:01:25.526 DEBUG:teuthology.orchestra.run.trial069:> sudo nvme disconnect -n lv_4 2026-02-12T11:01:25.784 INFO:teuthology.orchestra.run.trial069.stdout:NQN:lv_4 disconnected 1 controller(s) 2026-02-12T11:01:25.786 DEBUG:teuthology.orchestra.run.trial069:> set -ex 2026-02-12T11:01:25.786 DEBUG:teuthology.orchestra.run.trial069:> sudo dd of=/scratch_devs 2026-02-12T11:01:25.812 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T11:01:25.827 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T11:01:25.828 DEBUG:teuthology.orchestra.run.trial031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T11:01:25.830 DEBUG:teuthology.orchestra.run.trial069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T11:01:25.845 INFO:teuthology.orchestra.run.trial031.stderr:bash: line 1: ntpq: command not found 2026-02-12T11:01:25.866 INFO:teuthology.orchestra.run.trial069.stderr:bash: line 1: ntpq: command not found 2026-02-12T11:01:25.886 INFO:teuthology.orchestra.run.trial069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T11:01:25.886 INFO:teuthology.orchestra.run.trial069.stdout:=============================================================================== 2026-02-12T11:01:25.886 INFO:teuthology.orchestra.run.trial069.stdout:^- ntp6.kernfusion.at 2 6 77 63 +295us[ +295us] +/- 47ms 2026-02-12T11:01:25.886 INFO:teuthology.orchestra.run.trial069.stdout:^? 23.186.168.129 0 8 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T11:01:25.886 INFO:teuthology.orchestra.run.trial069.stdout:^- daisy.zia.io 2 6 77 63 -1505us[-1505us] +/- 44ms 2026-02-12T11:01:25.886 INFO:teuthology.orchestra.run.trial069.stdout:^* chi3.us.ntp.li 2 6 77 63 +253us[ -144us] +/- 11ms 2026-02-12T11:01:25.895 INFO:teuthology.orchestra.run.trial031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T11:01:25.895 INFO:teuthology.orchestra.run.trial031.stdout:=============================================================================== 2026-02-12T11:01:25.895 INFO:teuthology.orchestra.run.trial031.stdout:^+ 99-28-14-242.lightspeed.> 1 6 77 63 +381us[ +685us] +/- 14ms 2026-02-12T11:01:25.895 INFO:teuthology.orchestra.run.trial031.stdout:^- 170-187-147-56.ip.linode> 2 6 77 63 -7351us[-7046us] +/- 83ms 2026-02-12T11:01:25.895 INFO:teuthology.orchestra.run.trial031.stdout:^* ntp.netlinkify.com 2 6 77 61 -331us[ -23us] +/- 8111us 2026-02-12T11:01:25.895 INFO:teuthology.orchestra.run.trial031.stdout:^- wdc1.us.ntp.li 3 6 77 63 -463us[ -159us] +/- 29ms 2026-02-12T11:01:25.896 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T11:01:25.912 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T11:01:25.912 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T11:01:25.927 DEBUG:teuthology.orchestra.run.trial031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T11:01:25.987 DEBUG:teuthology.orchestra.run.trial069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T11:01:26.040 DEBUG:teuthology.orchestra.run.trial031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-12T11:01:26.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T11:01:26.068 DEBUG:teuthology.orchestra.run.trial069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-12T11:01:26.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T11:01:26.095 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T11:01:26.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T11:01:26.139 INFO:teuthology.task.internal:Duration was 272.546466 seconds 2026-02-12T11:01:26.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T11:01:26.168 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T11:01:26.168 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T11:01:26.171 DEBUG:teuthology.orchestra.run.trial069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T11:01:26.206 INFO:teuthology.orchestra.run.trial031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T11:01:26.210 INFO:teuthology.orchestra.run.trial069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T11:01:26.500 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T11:01:26.500 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial031.front.sepia.ceph.com 2026-02-12T11:01:26.501 DEBUG:teuthology.orchestra.run.trial031:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T11:01:26.522 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial069.front.sepia.ceph.com 2026-02-12T11:01:26.522 DEBUG:teuthology.orchestra.run.trial069:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T11:01:26.559 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T11:01:26.559 DEBUG:teuthology.orchestra.run.trial031:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T11:01:26.564 DEBUG:teuthology.orchestra.run.trial069:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T11:01:26.666 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T11:01:26.667 DEBUG:teuthology.orchestra.run.trial031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T11:01:26.669 DEBUG:teuthology.orchestra.run.trial069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T11:01:26.691 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T11:01:26.691 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T11:01:26.692 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T11:01:26.692 INFO:teuthology.orchestra.run.trial031.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T11:01:26.692 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T11:01:26.693 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T11:01:26.693 INFO:teuthology.orchestra.run.trial069.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T11:01:26.694 INFO:teuthology.orchestra.run.trial069.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T11:01:26.694 INFO:teuthology.orchestra.run.trial069.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T11:01:26.694 INFO:teuthology.orchestra.run.trial069.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T11:01:26.700 INFO:teuthology.orchestra.run.trial069.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T11:01:26.707 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T11:01:26.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T11:01:26.725 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T11:01:26.726 DEBUG:teuthology.orchestra.run.trial031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T11:01:26.775 DEBUG:teuthology.orchestra.run.trial069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T11:01:26.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T11:01:26.820 DEBUG:teuthology.orchestra.run.trial031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T11:01:26.822 DEBUG:teuthology.orchestra.run.trial069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T11:01:26.843 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern = core 2026-02-12T11:01:26.865 INFO:teuthology.orchestra.run.trial069.stdout:kernel.core_pattern = core 2026-02-12T11:01:26.884 DEBUG:teuthology.orchestra.run.trial031:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T11:01:26.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T11:01:26.916 DEBUG:teuthology.orchestra.run.trial069:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T11:01:26.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T11:01:26.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T11:01:26.959 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T11:01:26.960 DEBUG:teuthology.misc:Transferring archived files from trial031:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340/remote/trial031 2026-02-12T11:01:26.960 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T11:01:26.993 DEBUG:teuthology.misc:Transferring archived files from trial069:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43340/remote/trial069 2026-02-12T11:01:26.994 DEBUG:teuthology.orchestra.run.trial069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T11:01:27.021 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T11:01:27.021 DEBUG:teuthology.orchestra.run.trial031:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T11:01:27.030 DEBUG:teuthology.orchestra.run.trial069:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T11:01:27.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T11:01:27.091 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T11:01:27.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T11:01:27.105 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T11:01:27.105 DEBUG:teuthology.orchestra.run.trial031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T11:01:27.107 DEBUG:teuthology.orchestra.run.trial069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T11:01:27.121 INFO:teuthology.orchestra.run.trial031.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 11:01 /home/ubuntu/cephtest 2026-02-12T11:01:27.135 INFO:teuthology.orchestra.run.trial069.stdout: 791883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 11:01 /home/ubuntu/cephtest 2026-02-12T11:01:27.137 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T11:01:27.155 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T11:01:27.189 INFO:teuthology.run:Summary data: description: rados:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} duration: 272.5464663505554 owner: scheduled_dgalloway@soko04.front.sepia.ceph.com success: true 2026-02-12T11:01:27.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T11:01:27.309 INFO:teuthology.run:pass