2026-02-12T10:47:16.801 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T10:47:16.815 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:47:16.890 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325 branch: wip-squid-pr-67199-kefu-1 description: rados:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_host_drain} email: null first_in_suite: false flavor: default job_id: '43325' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-squid-pr-67199-kefu-1 ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - MON_DOWN - mons down - mon down - out of quorum - CEPHADM_STRAY_HOST - CEPHADM_STRAY_DAEMON - CEPHADM_FAILED_DAEMON log-only-match: - CEPHADM_ sha1: 05b55d192f002ad5df41409624b8d176527d0841 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 05b55d192f002ad5df41409624b8d176527d0841 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-squid-pr-67199-kefu-1 sha1: 05b55d192f002ad5df41409624b8d176527d0841 owner: scheduled_dgalloway@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - mon.a - mgr.a - osd.0 - osd.1 - - host.b - mon.b - mgr.b - osd.2 - osd.3 - - host.c - mon.c - osd.4 - osd.5 seed: 7179 sha1: 05b55d192f002ad5df41409624b8d176527d0841 sleep_before_teardown: 0 subset: 110/120000 suite: rados:cephadm suite_branch: wip-squid-pr-67199-kefu-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 05b55d192f002ad5df41409624b8d176527d0841 targets: trial028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApIWWQs9+RsEH47a7cT0KI6O+9VQ85zXdzURVd3GzTrK7KPMDjfH4PolA7trpPYyhL1GFi7gNlIpUHWg1l52is= trial049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/UAt7CRRPdwkbsvX0PyWRDEYVQHPsPbopkQoYu04B0giiRuAkc5Sj5ZTXl+CCdA/RWhYTqJuATa23fBNZiqZs= trial157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrjtacVqc+26MLgviJVojEKGOZDuTXoJvc1vuykoBjKUS+GbMmhinFC315wklkm65QuMT2npzC3nCur/98JGe4= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: null - cephadm.shell: host.a: - "set -ex\nHOSTNAMES=$(ceph orch host ls --format json | jq -r '.[] | .hostname')\n\ for host in $HOSTNAMES; do\n # find the hostname for \"host.c\" which will\ \ have no mgr\n HAS_MGRS=$(ceph orch ps --hostname ${host} --format json |\ \ jq 'any(.daemon_type == \"mgr\")')\n if [ \"$HAS_MGRS\" == \"false\" ]; then\n\ \ HOST_C=\"${host}\"\n fi\ndone\n# One last thing to worry about before\ \ draining the host\n# is that the teuthology test tends to put the explicit\n\ # hostnames in the placement for the mon service.\n# We want to make sure we\ \ can drain without providing\n# --force and there is a check for the host being\ \ removed\n# being listed explicitly in the placements. Therefore,\n# we should\ \ remove it from the mon placement.\nceph orch ls mon --export > mon.yaml\n\ sed /\"$HOST_C\"/d mon.yaml > mon_adjusted.yaml\nceph orch apply -i mon_adjusted.yaml\n\ # now drain that host\nceph orch host drain $HOST_C --zap-osd-devices\n# wait\ \ for drain to complete\nHOST_C_DAEMONS=$(ceph orch ps --hostname $HOST_C)\n\ while [ \"$HOST_C_DAEMONS\" != \"No daemons reported\" ]; do\n sleep 15\n \ \ HOST_C_DAEMONS=$(ceph orch ps --hostname $HOST_C)\ndone\n# we want to check\ \ the ability to remove the host from\n# the CRUSH map, so we should first verify\ \ the host is in\n# the CRUSH map.\nceph osd getcrushmap -o compiled-crushmap\n\ crushtool -d compiled-crushmap -o crushmap.txt\nCRUSH_MAP=$(cat crushmap.txt)\n\ if ! grep -q \"$HOST_C\" <<< \"$CRUSH_MAP\"; then\n printf \"Expected to see\ \ $HOST_C in CRUSH map. Saw:\\n\\n$CRUSH_MAP\"\n exit 1\nfi\n# If the drain\ \ was successful, we should be able to remove the\n# host without force with\ \ no issues. If there are still daemons\n# we will get a response telling us\ \ to drain the host and a\n# non-zero return code\nceph orch host rm $HOST_C\ \ --rm-crush-entry\n# verify we've successfully removed the host from the CRUSH\ \ map\nsleep 30\nceph osd getcrushmap -o compiled-crushmap\ncrushtool -d compiled-crushmap\ \ -o crushmap.txt\nCRUSH_MAP=$(cat crushmap.txt)\nif grep -q \"$HOST_C\" <<<\ \ \"$CRUSH_MAP\"; then\n printf \"Saw $HOST_C in CRUSH map after it should\ \ have been removed.\\n\\n$CRUSH_MAP\"\n exit 1\nfi\n" teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c433f1062990a0488dc29a553589bc609a460691 timestamp: 2026-02-10_16:16:29 tube: trial user: dgalloway verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T10:47:16.891 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa; will attempt to use it 2026-02-12T10:47:16.891 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_05b55d192f002ad5df41409624b8d176527d0841/qa/tasks 2026-02-12T10:47:16.891 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T10:47:16.893 INFO:teuthology.task.internal:Checking packages... 2026-02-12T10:47:16.893 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '05b55d192f002ad5df41409624b8d176527d0841' 2026-02-12T10:47:16.893 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T10:47:16.893 INFO:teuthology.packaging:ref: None 2026-02-12T10:47:16.893 INFO:teuthology.packaging:tag: None 2026-02-12T10:47:16.893 INFO:teuthology.packaging:branch: wip-squid-pr-67199-kefu-1 2026-02-12T10:47:16.893 INFO:teuthology.packaging:sha1: 05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:47:16.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-squid-pr-67199-kefu-1 2026-02-12T10:47:17.006 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-680.g05b55d19 2026-02-12T10:47:17.008 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T10:47:17.023 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T10:47:17.023 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T10:47:17.035 INFO:teuthology.task.internal:Saving configuration 2026-02-12T10:47:17.046 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T10:47:17.059 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T10:47:17.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial028.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 10:43:57.360930', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApIWWQs9+RsEH47a7cT0KI6O+9VQ85zXdzURVd3GzTrK7KPMDjfH4PolA7trpPYyhL1GFi7gNlIpUHWg1l52is='} 2026-02-12T10:47:17.186 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial049.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 10:43:57.361289', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/UAt7CRRPdwkbsvX0PyWRDEYVQHPsPbopkQoYu04B0giiRuAkc5Sj5ZTXl+CCdA/RWhYTqJuATa23fBNZiqZs='} 2026-02-12T10:47:17.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial157.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 10:43:57.360342', 'locked_by': 'scheduled_dgalloway@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrjtacVqc+26MLgviJVojEKGOZDuTXoJvc1vuykoBjKUS+GbMmhinFC315wklkm65QuMT2npzC3nCur/98JGe4='} 2026-02-12T10:47:17.240 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T10:47:17.251 INFO:teuthology.task.internal:roles: ubuntu@trial028.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.a', 'osd.0', 'osd.1'] 2026-02-12T10:47:17.251 INFO:teuthology.task.internal:roles: ubuntu@trial049.front.sepia.ceph.com - ['host.b', 'mon.b', 'mgr.b', 'osd.2', 'osd.3'] 2026-02-12T10:47:17.251 INFO:teuthology.task.internal:roles: ubuntu@trial157.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.4', 'osd.5'] 2026-02-12T10:47:17.251 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T10:47:17.439 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7dc6ad0e56c0>, signals=[15]) 2026-02-12T10:47:17.439 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T10:47:17.452 INFO:teuthology.task.internal:Opening connections... 2026-02-12T10:47:17.452 DEBUG:teuthology.task.internal:connecting to ubuntu@trial028.front.sepia.ceph.com 2026-02-12T10:47:17.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:47:17.516 DEBUG:teuthology.task.internal:connecting to ubuntu@trial049.front.sepia.ceph.com 2026-02-12T10:47:17.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:47:17.575 DEBUG:teuthology.task.internal:connecting to ubuntu@trial157.front.sepia.ceph.com 2026-02-12T10:47:17.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:47:17.638 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T10:47:17.648 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-12T10:47:17.664 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-12T10:47:17.664 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream" 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9" 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos" 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9" 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:47:17.721 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31" 2026-02-12T10:47:17.722 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:47:17.722 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:47:17.722 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:47:17.722 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:47:17.722 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:47:17.722 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:47:17.723 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-12T10:47:17.798 DEBUG:teuthology.orchestra.run.trial049:> uname -m 2026-02-12T10:47:17.812 INFO:teuthology.orchestra.run.trial049.stdout:x86_64 2026-02-12T10:47:17.812 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:47:17.869 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:47:17.870 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server 2026-02-12T10:47:17.952 DEBUG:teuthology.orchestra.run.trial157:> uname -m 2026-02-12T10:47:17.967 INFO:teuthology.orchestra.run.trial157.stdout:x86_64 2026-02-12T10:47:17.967 DEBUG:teuthology.orchestra.run.trial157:> cat /etc/os-release 2026-02-12T10:47:18.023 INFO:teuthology.orchestra.run.trial157.stdout:NAME="CentOS Stream" 2026-02-12T10:47:18.023 INFO:teuthology.orchestra.run.trial157.stdout:VERSION="9" 2026-02-12T10:47:18.023 INFO:teuthology.orchestra.run.trial157.stdout:ID="centos" 2026-02-12T10:47:18.023 INFO:teuthology.orchestra.run.trial157.stdout:ID_LIKE="rhel fedora" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:VERSION_ID="9" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:PLATFORM_ID="platform:el9" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:ANSI_COLOR="0;31" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:LOGO="fedora-logo-icon" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:HOME_URL="https://centos.org/" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T10:47:18.024 INFO:teuthology.orchestra.run.trial157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T10:47:18.024 INFO:teuthology.lock.ops:Updating trial157.front.sepia.ceph.com on lock server 2026-02-12T10:47:18.107 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T10:47:18.120 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T10:47:18.131 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T10:47:18.132 DEBUG:teuthology.orchestra.run.trial028:> test '!' -e /home/ubuntu/cephtest 2026-02-12T10:47:18.133 DEBUG:teuthology.orchestra.run.trial049:> test '!' -e /home/ubuntu/cephtest 2026-02-12T10:47:18.135 DEBUG:teuthology.orchestra.run.trial157:> test '!' -e /home/ubuntu/cephtest 2026-02-12T10:47:18.150 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T10:47:18.161 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T10:47:18.161 DEBUG:teuthology.orchestra.run.trial028:> test -z $(ls -A /var/lib/ceph) 2026-02-12T10:47:18.189 DEBUG:teuthology.orchestra.run.trial049:> test -z $(ls -A /var/lib/ceph) 2026-02-12T10:47:18.191 DEBUG:teuthology.orchestra.run.trial157:> test -z $(ls -A /var/lib/ceph) 2026-02-12T10:47:18.208 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T10:47:18.427 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T10:47:18.446 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-12T10:47:18.446 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-12T10:47:18.447 DEBUG:teuthology.orchestra.run.trial028:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T10:47:18.447 DEBUG:teuthology.orchestra.run.trial049:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T10:47:18.447 DEBUG:teuthology.orchestra.run.trial157:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T10:47:18.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:47:18.462 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-12T10:47:18.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:47:18.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:47:18.462 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T10:47:18.462 DEBUG:teuthology.orchestra.run.trial157:> uname -r 2026-02-12T10:47:18.517 INFO:teuthology.orchestra.run.trial157.stdout:5.14.0-645.el9.x86_64 2026-02-12T10:47:18.517 INFO:teuthology.task.kernel:Running kernel on trial157: 5.14.0-645.el9.x86_64 2026-02-12T10:47:18.517 DEBUG:teuthology.orchestra.run.trial157:> sudo yum install -y kernel 2026-02-12T10:47:18.517 INFO:teuthology.orchestra.run.trial028.stdout:5.14.0-645.el9.x86_64 2026-02-12T10:47:18.518 INFO:teuthology.task.kernel:Running kernel on trial028: 5.14.0-645.el9.x86_64 2026-02-12T10:47:18.518 DEBUG:teuthology.orchestra.run.trial028:> sudo yum install -y kernel 2026-02-12T10:47:18.518 INFO:teuthology.orchestra.run.trial049.stdout:5.14.0-645.el9.x86_64 2026-02-12T10:47:18.518 INFO:teuthology.task.kernel:Running kernel on trial049: 5.14.0-645.el9.x86_64 2026-02-12T10:47:18.518 DEBUG:teuthology.orchestra.run.trial049:> sudo yum install -y kernel 2026-02-12T10:47:19.468 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.9 MB 00:00 2026-02-12T10:47:20.268 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.9 MB 00:01 2026-02-12T10:47:23.270 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T10:47:26.554 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 7.8 MB 00:00 2026-02-12T10:47:26.902 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-12T10:47:27.621 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 20 kB 00:00 2026-02-12T10:47:28.903 INFO:teuthology.orchestra.run.trial157.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-12T10:47:29.883 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T10:47:32.135 INFO:teuthology.orchestra.run.trial157.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-12T10:47:32.655 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 27 MB 00:12 2026-02-12T10:47:33.196 INFO:teuthology.orchestra.run.trial157.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T10:47:33.215 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:47:33.216 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:47:33.216 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:47:33.217 INFO:teuthology.orchestra.run.trial157.stdout:Install 4 Packages 2026-02-12T10:47:33.218 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:47:33.218 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 88 M 2026-02-12T10:47:33.218 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 135 M 2026-02-12T10:47:33.218 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:47:33.281 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-12T10:47:33.910 INFO:teuthology.orchestra.run.trial157.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 1.2 MB/s | 768 kB 00:00 2026-02-12T10:47:34.476 INFO:teuthology.orchestra.run.trial157.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-12T10:47:34.690 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 20 kB 00:00 2026-02-12T10:47:35.004 INFO:teuthology.orchestra.run.trial157.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 28 MB/s | 31 MB 00:01 2026-02-12T10:47:35.151 INFO:teuthology.orchestra.run.trial157.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-12T10:47:35.151 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:47:35.151 INFO:teuthology.orchestra.run.trial157.stdout:Total 46 MB/s | 88 MB 00:01 2026-02-12T10:47:35.342 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:47:35.538 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:47:35.539 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:47:35.884 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:47:35.884 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:47:36.099 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-12T10:47:36.728 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 7.8 MB 00:01 2026-02-12T10:47:36.964 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:47:37.249 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:47:37.268 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:47:37.596 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - Extras packages 134 kB/s | 20 kB 00:00 2026-02-12T10:47:38.515 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-12T10:47:39.029 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:47:39.057 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:47:39.310 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-12T10:47:40.383 INFO:teuthology.orchestra.run.trial028.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T10:47:40.403 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:47:40.404 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:47:40.404 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-12T10:47:40.404 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:47:40.404 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:47:40.404 INFO:teuthology.orchestra.run.trial028.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T10:47:40.404 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout:Install 4 Packages 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:47:40.405 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 88 M 2026-02-12T10:47:40.406 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 135 M 2026-02-12T10:47:40.406 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:47:40.531 INFO:teuthology.orchestra.run.trial028.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 12 MB/s | 768 kB 00:00 2026-02-12T10:47:40.639 INFO:teuthology.orchestra.run.trial028.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 100 MB/s | 17 MB 00:00 2026-02-12T10:47:40.742 INFO:teuthology.orchestra.run.trial028.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 146 MB/s | 31 MB 00:00 2026-02-12T10:47:40.986 INFO:teuthology.orchestra.run.trial028.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 77 MB/s | 40 MB 00:00 2026-02-12T10:47:40.988 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:47:40.989 INFO:teuthology.orchestra.run.trial028.stdout:Total 151 MB/s | 88 MB 00:00 2026-02-12T10:47:41.180 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:47:41.383 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:47:41.384 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:47:41.672 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-12T10:47:41.731 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:47:41.731 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:47:42.083 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:47:42.088 INFO:teuthology.orchestra.run.trial157.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:47:42.730 INFO:teuthology.orchestra.run.trial049.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T10:47:42.750 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:47:42.751 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:47:42.751 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T10:47:42.751 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:47:42.751 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:47:42.751 INFO:teuthology.orchestra.run.trial049.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T10:47:42.751 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T10:47:42.751 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout:Install 4 Packages 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 88 M 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 135 M 2026-02-12T10:47:42.752 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:47:42.823 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:47:42.870 INFO:teuthology.orchestra.run.trial049.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 12 MB/s | 768 kB 00:00 2026-02-12T10:47:42.960 INFO:teuthology.orchestra.run.trial049.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 113 MB/s | 17 MB 00:00 2026-02-12T10:47:43.053 INFO:teuthology.orchestra.run.trial049.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 168 MB/s | 31 MB 00:00 2026-02-12T10:47:43.108 INFO:teuthology.orchestra.run.trial028.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:47:43.109 INFO:teuthology.orchestra.run.trial049.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 132 MB/s | 40 MB 00:00 2026-02-12T10:47:43.109 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:47:43.109 INFO:teuthology.orchestra.run.trial049.stdout:Total 247 MB/s | 88 MB 00:00 2026-02-12T10:47:43.127 INFO:teuthology.orchestra.run.trial028.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:47:43.299 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:47:43.500 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:47:43.500 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:47:43.847 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:47:43.848 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:47:44.887 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:47:44.916 INFO:teuthology.orchestra.run.trial028.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:47:44.939 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:47:45.121 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:47:45.224 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:47:45.244 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:47:47.007 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:47:47.035 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:47:47.938 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:47:47.944 INFO:teuthology.orchestra.run.trial028.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:47:50.064 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:47:50.070 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:47:50.971 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:47:53.103 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:15.436 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:15.458 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:15.626 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:15.627 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:48:15.627 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:48:15.627 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:48:15.679 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:15.679 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:48:15.679 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:48:15.680 INFO:teuthology.orchestra.run.trial157.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:15.680 INFO:teuthology.orchestra.run.trial157.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T10:48:15.680 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T10:48:15.680 INFO:teuthology.orchestra.run.trial157.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T10:48:15.680 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:48:15.680 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:48:15.738 DEBUG:teuthology.orchestra.run.trial157:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:48:15.763 INFO:teuthology.orchestra.run.trial157.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:15.764 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:48:15.764 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T10:48:15.765 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T10:48:15.765 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T10:48:15.765 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2026-02-12T10:48:15.765 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial157.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T10:48:15.765 DEBUG:teuthology.orchestra.run.trial157:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:48:15.828 INFO:teuthology.orchestra.run.trial157.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:15.829 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:48:15.829 DEBUG:teuthology.orchestra.run.trial157:> sudo rpm -qi grub2-tools 2026-02-12T10:48:15.897 INFO:teuthology.orchestra.run.trial157.stdout:Name : grub2-tools 2026-02-12T10:48:15.897 INFO:teuthology.orchestra.run.trial157.stdout:Epoch : 1 2026-02-12T10:48:15.897 INFO:teuthology.orchestra.run.trial157.stdout:Version : 2.06 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Release : 118.el9 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Architecture: x86_64 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Group : Unspecified 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Size : 8393909 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:License : GPLv3+ 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T10:48:15.898 INFO:teuthology.orchestra.run.trial157.stdout:Packager : builder@centos.org 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:Vendor : CentOS 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:Summary : Support tools for GRUB. 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:Description : 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:hardware devices. 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:48:15.899 INFO:teuthology.orchestra.run.trial157.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T10:48:15.900 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T10:48:15.901 INFO:teuthology.task.kernel:Updating grub on trial157 to boot 5.14.0-677.el9.x86_64 2026-02-12T10:48:15.901 DEBUG:teuthology.orchestra.run.trial157:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T10:48:15.965 INFO:teuthology.orchestra.run.trial157.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T10:48:15.967 DEBUG:teuthology.orchestra.run.trial157:> sudo command -v grubby && echo yes || echo no 2026-02-12T10:48:16.031 INFO:teuthology.orchestra.run.trial157.stdout:/sbin/grubby 2026-02-12T10:48:16.033 INFO:teuthology.orchestra.run.trial157.stdout:yes 2026-02-12T10:48:16.033 DEBUG:teuthology.orchestra.run.trial157:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T10:48:16.097 INFO:teuthology.orchestra.run.trial157.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T10:48:16.098 DEBUG:teuthology.orchestra.run.trial157:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T10:48:16.173 DEBUG:teuthology.orchestra.run.trial157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T10:48:16.379 INFO:teuthology.orchestra.run.trial157.stderr:Generating grub configuration file ... 2026-02-12T10:48:16.443 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T10:48:16.449 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T10:48:16.702 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T10:48:16.708 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T10:48:16.740 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T10:48:16.746 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T10:48:16.769 INFO:teuthology.orchestra.run.trial157.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T10:48:16.775 INFO:teuthology.orchestra.run.trial157.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T10:48:16.857 INFO:teuthology.orchestra.run.trial157.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T10:48:16.867 INFO:teuthology.orchestra.run.trial157.stderr:done 2026-02-12T10:48:16.869 DEBUG:teuthology.orchestra.run.trial157:> test -d /sys/firmware/efi 2026-02-12T10:48:16.884 DEBUG:teuthology.orchestra.run.trial157:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T10:48:16.949 INFO:teuthology.orchestra.run.trial157.stdout:/boot/efi/EFI/BOOT 2026-02-12T10:48:16.949 INFO:teuthology.orchestra.run.trial157.stdout:/boot/efi/EFI/centos 2026-02-12T10:48:16.951 DEBUG:teuthology.orchestra.run.trial157:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T10:48:17.017 INFO:teuthology.orchestra.run.trial157.stdout:no 2026-02-12T10:48:17.018 DEBUG:teuthology.orchestra.run.trial157:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T10:48:17.081 INFO:teuthology.orchestra.run.trial157.stdout:yes 2026-02-12T10:48:17.081 DEBUG:teuthology.orchestra.run.trial157:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T10:48:17.145 DEBUG:teuthology.orchestra.run.trial157:> sudo shutdown -r now 2026-02-12T10:48:21.365 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:21.385 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:21.557 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:21.558 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:48:21.558 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:48:21.558 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T10:48:21.612 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:48:21.613 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:48:21.671 DEBUG:teuthology.orchestra.run.trial028:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:48:21.697 INFO:teuthology.orchestra.run.trial028.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:21.698 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:48:21.698 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T10:48:21.698 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T10:48:21.698 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T10:48:21.698 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-12T10:48:21.699 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial028.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T10:48:21.699 DEBUG:teuthology.orchestra.run.trial028:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:48:21.760 INFO:teuthology.orchestra.run.trial028.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:21.761 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:48:21.761 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -qi grub2-tools 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Name : grub2-tools 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Epoch : 1 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Version : 2.06 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Release : 118.el9 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Architecture: x86_64 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Group : Unspecified 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Size : 8393909 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:License : GPLv3+ 2026-02-12T10:48:21.831 INFO:teuthology.orchestra.run.trial028.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T10:48:21.832 INFO:teuthology.orchestra.run.trial028.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T10:48:21.832 INFO:teuthology.orchestra.run.trial028.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T10:48:21.832 INFO:teuthology.orchestra.run.trial028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T10:48:21.832 INFO:teuthology.orchestra.run.trial028.stdout:Packager : builder@centos.org 2026-02-12T10:48:21.832 INFO:teuthology.orchestra.run.trial028.stdout:Vendor : CentOS 2026-02-12T10:48:21.832 INFO:teuthology.orchestra.run.trial028.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T10:48:21.832 INFO:teuthology.orchestra.run.trial028.stdout:Summary : Support tools for GRUB. 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout:Description : 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout:hardware devices. 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:48:21.833 INFO:teuthology.orchestra.run.trial028.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T10:48:21.834 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T10:48:21.835 INFO:teuthology.task.kernel:Updating grub on trial028 to boot 5.14.0-677.el9.x86_64 2026-02-12T10:48:21.835 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T10:48:21.899 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T10:48:21.900 DEBUG:teuthology.orchestra.run.trial028:> sudo command -v grubby && echo yes || echo no 2026-02-12T10:48:21.964 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/grubby 2026-02-12T10:48:21.965 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-12T10:48:21.965 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T10:48:22.029 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T10:48:22.031 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T10:48:22.105 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T10:48:22.311 INFO:teuthology.orchestra.run.trial028.stderr:Generating grub configuration file ... 2026-02-12T10:48:22.373 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T10:48:22.380 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T10:48:22.628 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T10:48:22.634 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T10:48:22.666 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T10:48:22.673 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T10:48:22.697 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T10:48:22.703 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T10:48:22.785 INFO:teuthology.orchestra.run.trial028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T10:48:22.793 INFO:teuthology.orchestra.run.trial028.stderr:done 2026-02-12T10:48:22.796 DEBUG:teuthology.orchestra.run.trial028:> test -d /sys/firmware/efi 2026-02-12T10:48:22.811 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T10:48:22.878 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/BOOT 2026-02-12T10:48:22.879 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/centos 2026-02-12T10:48:22.880 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T10:48:22.944 INFO:teuthology.orchestra.run.trial028.stdout:no 2026-02-12T10:48:22.944 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T10:48:23.008 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-12T10:48:23.009 DEBUG:teuthology.orchestra.run.trial028:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T10:48:23.074 DEBUG:teuthology.orchestra.run.trial028:> sudo shutdown -r now 2026-02-12T10:48:23.146 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T10:48:23.464 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:23.484 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:23.655 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:23.655 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T10:48:23.655 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T10:48:23.655 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T10:48:23.707 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T10:48:23.707 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:48:23.708 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:48:23.708 INFO:teuthology.orchestra.run.trial049.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:23.708 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T10:48:23.708 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T10:48:23.708 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T10:48:23.708 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:48:23.708 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:48:23.766 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:48:23.792 INFO:teuthology.orchestra.run.trial049.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:23.793 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:48:23.793 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T10:48:23.793 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T10:48:23.793 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T10:48:23.793 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-12T10:48:23.793 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial049.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T10:48:23.794 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T10:48:23.856 INFO:teuthology.orchestra.run.trial049.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T10:48:23.857 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T10:48:23.857 DEBUG:teuthology.orchestra.run.trial049:> sudo rpm -qi grub2-tools 2026-02-12T10:48:23.925 INFO:teuthology.orchestra.run.trial049.stdout:Name : grub2-tools 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Epoch : 1 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Version : 2.06 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Release : 118.el9 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Architecture: x86_64 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Group : Unspecified 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Size : 8393909 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:License : GPLv3+ 2026-02-12T10:48:23.926 INFO:teuthology.orchestra.run.trial049.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:Packager : builder@centos.org 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:Vendor : CentOS 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:Summary : Support tools for GRUB. 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:Description : 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:48:23.927 INFO:teuthology.orchestra.run.trial049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T10:48:23.928 INFO:teuthology.orchestra.run.trial049.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T10:48:23.928 INFO:teuthology.orchestra.run.trial049.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T10:48:23.928 INFO:teuthology.orchestra.run.trial049.stdout:hardware devices. 2026-02-12T10:48:23.928 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:48:23.928 INFO:teuthology.orchestra.run.trial049.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T10:48:23.929 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T10:48:23.929 INFO:teuthology.task.kernel:Updating grub on trial049 to boot 5.14.0-677.el9.x86_64 2026-02-12T10:48:23.929 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T10:48:23.992 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T10:48:23.994 DEBUG:teuthology.orchestra.run.trial049:> sudo command -v grubby && echo yes || echo no 2026-02-12T10:48:24.056 INFO:teuthology.orchestra.run.trial049.stdout:/sbin/grubby 2026-02-12T10:48:24.058 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-12T10:48:24.058 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T10:48:24.122 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T10:48:24.123 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T10:48:24.196 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T10:48:24.407 INFO:teuthology.orchestra.run.trial049.stderr:Generating grub configuration file ... 2026-02-12T10:48:24.471 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T10:48:24.477 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T10:48:24.734 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T10:48:24.740 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T10:48:24.771 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T10:48:24.778 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T10:48:24.801 INFO:teuthology.orchestra.run.trial049.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T10:48:24.807 INFO:teuthology.orchestra.run.trial049.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T10:48:24.888 INFO:teuthology.orchestra.run.trial049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T10:48:24.896 INFO:teuthology.orchestra.run.trial049.stderr:done 2026-02-12T10:48:24.898 DEBUG:teuthology.orchestra.run.trial049:> test -d /sys/firmware/efi 2026-02-12T10:48:24.914 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T10:48:24.980 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/BOOT 2026-02-12T10:48:24.980 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/centos 2026-02-12T10:48:24.981 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T10:48:25.047 INFO:teuthology.orchestra.run.trial049.stdout:no 2026-02-12T10:48:25.047 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T10:48:25.111 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-12T10:48:25.112 DEBUG:teuthology.orchestra.run.trial049:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T10:48:25.176 DEBUG:teuthology.orchestra.run.trial049:> sudo shutdown -r now 2026-02-12T10:48:25.250 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T10:48:47.209 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2026-02-12T10:48:47.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-12T10:48:47.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:48:53.122 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-12T10:48:53.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-12T10:48:53.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:48:55.221 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-12T10:48:55.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T10:48:55.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:49:47.265 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T10:49:53.131 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T10:49:55.226 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T10:49:56.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-12T10:49:56.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:49:56.404 DEBUG:teuthology.orchestra.run.trial157:> true 2026-02-12T10:49:56.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-12T10:49:56.559 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T10:49:56.559 DEBUG:teuthology.orchestra.run.trial157:> uname -r 2026-02-12T10:49:56.617 INFO:teuthology.orchestra.run.trial157.stdout:5.14.0-677.el9.x86_64 2026-02-12T10:49:56.617 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T10:49:56.617 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T10:49:56.617 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T10:49:57.618 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2026-02-12T10:49:57.619 DEBUG:teuthology.orchestra.run.trial157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T10:49:57.648 INFO:teuthology.orchestra.run.trial157.stdout:ttyS1 2026-02-12T10:49:57.675 DEBUG:teuthology.parallel:result is None 2026-02-12T10:50:02.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-12T10:50:02.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:50:02.246 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-12T10:50:02.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-12T10:50:02.391 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T10:50:02.392 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-12T10:50:02.447 INFO:teuthology.orchestra.run.trial028.stdout:5.14.0-677.el9.x86_64 2026-02-12T10:50:02.447 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T10:50:02.447 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T10:50:02.447 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T10:50:03.448 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-12T10:50:03.448 DEBUG:teuthology.orchestra.run.trial028:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T10:50:03.478 INFO:teuthology.orchestra.run.trial028.stdout:ttyS1 2026-02-12T10:50:03.501 DEBUG:teuthology.parallel:result is None 2026-02-12T10:50:04.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T10:50:04.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:50:04.361 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T10:50:04.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T10:50:04.502 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T10:50:04.502 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T10:50:04.558 INFO:teuthology.orchestra.run.trial049.stdout:5.14.0-677.el9.x86_64 2026-02-12T10:50:04.558 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T10:50:04.558 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T10:50:04.558 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T10:50:05.559 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-12T10:50:05.559 DEBUG:teuthology.orchestra.run.trial049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T10:50:05.590 INFO:teuthology.orchestra.run.trial049.stdout:ttyS1 2026-02-12T10:50:05.614 DEBUG:teuthology.parallel:result is None 2026-02-12T10:50:05.614 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T10:50:05.626 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T10:50:05.627 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T10:50:05.630 DEBUG:teuthology.orchestra.run.trial049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T10:50:05.656 DEBUG:teuthology.orchestra.run.trial157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T10:50:05.673 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T10:50:05.685 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T10:50:05.699 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T10:50:05.699 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T10:50:05.702 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T10:50:05.714 DEBUG:teuthology.orchestra.run.trial157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T10:50:05.742 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T10:50:05.753 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T10:50:05.754 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T10:50:05.759 DEBUG:teuthology.orchestra.run.trial049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T10:50:05.772 DEBUG:teuthology.orchestra.run.trial157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T10:50:05.781 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:50:05.790 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:50:05.793 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:50:05.797 INFO:teuthology.orchestra.run.trial157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:50:05.802 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:50:05.811 INFO:teuthology.orchestra.run.trial157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T10:50:05.813 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T10:50:05.827 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T10:50:05.827 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T10:50:05.834 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T10:50:05.846 DEBUG:teuthology.orchestra.run.trial157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T10:50:05.877 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T10:50:05.894 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T10:50:05.894 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T10:50:05.899 DEBUG:teuthology.orchestra.run.trial049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T10:50:05.909 DEBUG:teuthology.orchestra.run.trial157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T10:50:05.932 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:50:06.027 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:50:06.051 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:50:06.180 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:50:06.205 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:50:06.206 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T10:50:06.269 DEBUG:teuthology.orchestra.run.trial049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:50:06.375 DEBUG:teuthology.orchestra.run.trial049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:50:06.401 DEBUG:teuthology.orchestra.run.trial049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:50:06.540 DEBUG:teuthology.orchestra.run.trial049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:50:06.564 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:50:06.564 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T10:50:06.628 DEBUG:teuthology.orchestra.run.trial157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:50:06.742 DEBUG:teuthology.orchestra.run.trial157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:50:06.767 DEBUG:teuthology.orchestra.run.trial157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:50:06.912 DEBUG:teuthology.orchestra.run.trial157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:50:06.938 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:50:06.938 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T10:50:07.001 DEBUG:teuthology.orchestra.run.trial028:> sudo service rsyslog restart 2026-02-12T10:50:07.004 DEBUG:teuthology.orchestra.run.trial049:> sudo service rsyslog restart 2026-02-12T10:50:07.007 DEBUG:teuthology.orchestra.run.trial157:> sudo service rsyslog restart 2026-02-12T10:50:07.030 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:50:07.033 INFO:teuthology.orchestra.run.trial049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:50:07.069 INFO:teuthology.orchestra.run.trial157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:50:07.558 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T10:50:07.571 INFO:teuthology.task.internal:Starting timer... 2026-02-12T10:50:07.571 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T10:50:07.594 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T10:50:07.612 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-12T10:50:07.613 DEBUG:teuthology.orchestra.run.trial028:> sudo service auditd rotate 2026-02-12T10:50:07.642 INFO:teuthology.orchestra.run.trial028.stdout:Rotating logs: 2026-02-12T10:50:07.644 DEBUG:teuthology.orchestra.run.trial049:> sudo service auditd rotate 2026-02-12T10:50:07.674 INFO:teuthology.orchestra.run.trial049.stdout:Rotating logs: 2026-02-12T10:50:07.676 DEBUG:teuthology.orchestra.run.trial157:> sudo service auditd rotate 2026-02-12T10:50:07.706 INFO:teuthology.orchestra.run.trial157.stdout:Rotating logs: 2026-02-12T10:50:07.708 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T10:50:07.708 DEBUG:teuthology.orchestra.run.trial028:> /usr/sbin/getenforce 2026-02-12T10:50:07.726 INFO:teuthology.orchestra.run.trial028.stdout:Permissive 2026-02-12T10:50:07.726 DEBUG:teuthology.orchestra.run.trial049:> /usr/sbin/getenforce 2026-02-12T10:50:07.743 INFO:teuthology.orchestra.run.trial049.stdout:Permissive 2026-02-12T10:50:07.743 DEBUG:teuthology.orchestra.run.trial157:> /usr/sbin/getenforce 2026-02-12T10:50:07.766 INFO:teuthology.orchestra.run.trial157.stdout:Permissive 2026-02-12T10:50:07.767 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial028.front.sepia.ceph.com': 'permissive', 'ubuntu@trial049.front.sepia.ceph.com': 'permissive', 'ubuntu@trial157.front.sepia.ceph.com': 'permissive'} 2026-02-12T10:50:07.767 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-12T10:50:07.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:50:07.794 DEBUG:teuthology.orchestra.run.trial049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-12T10:50:07.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:50:07.819 DEBUG:teuthology.orchestra.run.trial157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-12T10:50:07.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:50:07.844 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T10:50:07.844 DEBUG:teuthology.orchestra.run.trial028:> sudo /usr/sbin/setenforce permissive 2026-02-12T10:50:07.870 DEBUG:teuthology.orchestra.run.trial049:> sudo /usr/sbin/setenforce permissive 2026-02-12T10:50:07.894 DEBUG:teuthology.orchestra.run.trial157:> sudo /usr/sbin/setenforce permissive 2026-02-12T10:50:07.919 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T10:50:07.938 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T10:50:07.951 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T10:50:07.952 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial028.front.sepia.ceph.com,trial049.front.sepia.ceph.com,trial157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T10:51:19.763 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial028.front.sepia.ceph.com'), Remote(name='ubuntu@trial049.front.sepia.ceph.com'), Remote(name='ubuntu@trial157.front.sepia.ceph.com')] 2026-02-12T10:51:19.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-12T10:51:19.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:51:19.877 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-12T10:51:19.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-12T10:51:19.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T10:51:19.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:51:20.030 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T10:51:20.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T10:51:20.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-12T10:51:20.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T10:51:20.192 DEBUG:teuthology.orchestra.run.trial157:> true 2026-02-12T10:51:20.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial157.front.sepia.ceph.com' 2026-02-12T10:51:20.269 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T10:51:20.283 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T10:51:20.284 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T10:51:20.284 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:51:20.286 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T10:51:20.287 DEBUG:teuthology.orchestra.run.trial049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:51:20.289 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T10:51:20.289 DEBUG:teuthology.orchestra.run.trial157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:51:20.312 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T10:51:20.315 INFO:teuthology.orchestra.run.trial049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T10:51:20.324 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T10:51:20.327 INFO:teuthology.orchestra.run.trial049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T10:51:20.336 INFO:teuthology.orchestra.run.trial157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T10:51:20.343 INFO:teuthology.orchestra.run.trial028.stderr:sudo: ntpd: command not found 2026-02-12T10:51:20.347 INFO:teuthology.orchestra.run.trial049.stderr:sudo: ntpd: command not found 2026-02-12T10:51:20.347 INFO:teuthology.orchestra.run.trial157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T10:51:20.353 INFO:teuthology.orchestra.run.trial028.stdout:506 Cannot talk to daemon 2026-02-12T10:51:20.357 INFO:teuthology.orchestra.run.trial049.stdout:506 Cannot talk to daemon 2026-02-12T10:51:20.365 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T10:51:20.368 INFO:teuthology.orchestra.run.trial049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T10:51:20.369 INFO:teuthology.orchestra.run.trial157.stderr:sudo: ntpd: command not found 2026-02-12T10:51:20.377 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T10:51:20.379 INFO:teuthology.orchestra.run.trial157.stdout:506 Cannot talk to daemon 2026-02-12T10:51:20.380 INFO:teuthology.orchestra.run.trial049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T10:51:20.391 INFO:teuthology.orchestra.run.trial157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T10:51:20.402 INFO:teuthology.orchestra.run.trial157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T10:51:20.420 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:51:20.422 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:51:20.422 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-12T10:51:20.425 INFO:teuthology.orchestra.run.trial049.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:51:20.426 INFO:teuthology.orchestra.run.trial049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:51:20.427 INFO:teuthology.orchestra.run.trial049.stdout:=============================================================================== 2026-02-12T10:51:20.451 INFO:teuthology.orchestra.run.trial157.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:51:20.456 INFO:teuthology.orchestra.run.trial157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:51:20.456 INFO:teuthology.orchestra.run.trial157.stdout:=============================================================================== 2026-02-12T10:51:20.457 INFO:teuthology.orchestra.run.trial157.stdout:^? 155.248.196.28 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T10:51:20.458 INFO:teuthology.run_tasks:Running task pexec... 2026-02-12T10:51:20.474 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-12T10:51:20.475 DEBUG:teuthology.orchestra.run.trial028:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T10:51:20.476 DEBUG:teuthology.orchestra.run.trial049:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T10:51:20.476 DEBUG:teuthology.orchestra.run.trial157:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-12T10:51:20.479 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial049.front.sepia.ceph.com 2026-02-12T10:51:20.479 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-12T10:51:20.479 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-12T10:51:20.481 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial028.front.sepia.ceph.com 2026-02-12T10:51:20.481 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-12T10:51:20.481 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-12T10:51:20.501 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial157.front.sepia.ceph.com 2026-02-12T10:51:20.501 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-12T10:51:20.501 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-12T10:51:20.650 INFO:teuthology.orchestra.run.trial028.stdout:No match for argument: nvme-cli 2026-02-12T10:51:20.651 INFO:teuthology.orchestra.run.trial028.stderr:No packages marked for removal. 2026-02-12T10:51:20.653 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:51:20.653 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:51:20.654 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:51:20.655 INFO:teuthology.orchestra.run.trial049.stdout:No match for argument: nvme-cli 2026-02-12T10:51:20.655 INFO:teuthology.orchestra.run.trial049.stderr:No packages marked for removal. 2026-02-12T10:51:20.657 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:51:20.658 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:51:20.658 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:51:20.674 INFO:teuthology.orchestra.run.trial157.stdout:No match for argument: nvme-cli 2026-02-12T10:51:20.675 INFO:teuthology.orchestra.run.trial157.stderr:No packages marked for removal. 2026-02-12T10:51:20.677 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:51:20.678 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:51:20.678 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:51:20.948 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:30 ago on Thu 12 Feb 2026 10:50:50 AM UTC. 2026-02-12T10:51:20.952 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 10:50:51 AM UTC. 2026-02-12T10:51:20.970 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 10:50:51 AM UTC. 2026-02-12T10:51:21.030 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:51:21.030 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-12T10:51:21.031 INFO:teuthology.orchestra.run.trial028.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout:Install 6 Packages 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 1 Package 2026-02-12T10:51:21.032 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:21.033 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 2.4 M 2026-02-12T10:51:21.033 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:51:21.035 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout:Upgrading: 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-12T10:51:21.036 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout:Install 6 Packages 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout:Upgrade 1 Package 2026-02-12T10:51:21.037 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:21.038 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 2.4 M 2026-02-12T10:51:21.038 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:51:21.052 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout:Upgrading: 2026-02-12T10:51:21.053 INFO:teuthology.orchestra.run.trial157.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout:Install 6 Packages 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout:Upgrade 1 Package 2026-02-12T10:51:21.054 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:21.055 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 2.4 M 2026-02-12T10:51:21.055 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:51:21.385 INFO:teuthology.orchestra.run.trial157.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 1.8 MB/s | 44 kB 00:00 2026-02-12T10:51:21.394 INFO:teuthology.orchestra.run.trial157.stdout:(2/7): python3-kmod-0.9-32.el9.x86_64.rpm 10 MB/s | 84 kB 00:00 2026-02-12T10:51:21.400 INFO:teuthology.orchestra.run.trial157.stdout:(3/7): nvme-cli-2.16-1.el9.x86_64.rpm 31 MB/s | 1.2 MB 00:00 2026-02-12T10:51:21.403 INFO:teuthology.orchestra.run.trial157.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 16 MB/s | 150 kB 00:00 2026-02-12T10:51:21.409 INFO:teuthology.orchestra.run.trial157.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 19 MB/s | 116 kB 00:00 2026-02-12T10:51:21.512 INFO:teuthology.orchestra.run.trial157.stdout:(6/7): python3-configshell-1.1.30-1.el9.noarch. 478 kB/s | 72 kB 00:00 2026-02-12T10:51:21.711 INFO:teuthology.orchestra.run.trial049.stdout:(1/7): python3-configshell-1.1.30-1.el9.noarch. 117 kB/s | 72 kB 00:00 2026-02-12T10:51:21.724 INFO:teuthology.orchestra.run.trial049.stdout:(2/7): nvmetcli-0.8-3.el9.noarch.rpm 70 kB/s | 44 kB 00:00 2026-02-12T10:51:21.735 INFO:teuthology.orchestra.run.trial157.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 2.4 MB/s | 837 kB 00:00 2026-02-12T10:51:21.735 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:21.735 INFO:teuthology.orchestra.run.trial157.stdout:Total 3.6 MB/s | 2.4 MB 00:00 2026-02-12T10:51:21.800 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:51:21.807 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:51:21.807 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:51:21.861 INFO:teuthology.orchestra.run.trial028.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 75 kB/s | 44 kB 00:00 2026-02-12T10:51:21.870 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:51:21.870 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:51:21.920 INFO:teuthology.orchestra.run.trial028.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 112 kB/s | 72 kB 00:00 2026-02-12T10:51:21.940 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:51:21.940 INFO:teuthology.orchestra.run.trial049.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 368 kB/s | 84 kB 00:00 2026-02-12T10:51:21.955 INFO:teuthology.orchestra.run.trial049.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 650 kB/s | 150 kB 00:00 2026-02-12T10:51:22.007 INFO:teuthology.orchestra.run.trial157.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-12T10:51:22.014 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-12T10:51:22.023 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-12T10:51:22.029 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-12T10:51:22.034 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-12T10:51:22.035 INFO:teuthology.orchestra.run.trial157.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-12T10:51:22.166 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-12T10:51:22.169 INFO:teuthology.orchestra.run.trial157.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-12T10:51:22.188 INFO:teuthology.orchestra.run.trial049.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 499 kB/s | 116 kB 00:00 2026-02-12T10:51:22.222 INFO:teuthology.orchestra.run.trial028.stdout:(3/7): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-12T10:51:22.450 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-12T10:51:22.450 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T10:51:22.451 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:22.474 INFO:teuthology.orchestra.run.trial157.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:22.505 INFO:teuthology.orchestra.run.trial028.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 131 kB/s | 84 kB 00:00 2026-02-12T10:51:22.630 INFO:teuthology.orchestra.run.trial028.stdout:(5/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 212 kB/s | 150 kB 00:00 2026-02-12T10:51:22.689 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:22.689 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-12T10:51:22.690 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-12T10:51:22.690 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-12T10:51:22.690 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-12T10:51:22.690 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-12T10:51:22.690 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-12T10:51:22.690 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-12T10:51:22.742 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout:Upgraded: 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:22.743 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:51:22.776 DEBUG:teuthology.parallel:result is None 2026-02-12T10:51:22.929 INFO:teuthology.orchestra.run.trial049.stdout:(6/7): nvme-cli-2.16-1.el9.x86_64.rpm 644 kB/s | 1.2 MB 00:01 2026-02-12T10:51:22.994 INFO:teuthology.orchestra.run.trial049.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 795 kB/s | 837 kB 00:01 2026-02-12T10:51:22.995 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:22.995 INFO:teuthology.orchestra.run.trial049.stdout:Total 1.2 MB/s | 2.4 MB 00:01 2026-02-12T10:51:23.058 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:51:23.066 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:51:23.066 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:51:23.129 INFO:teuthology.orchestra.run.trial028.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 924 kB/s | 837 kB 00:00 2026-02-12T10:51:23.130 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:51:23.130 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:51:23.185 INFO:teuthology.orchestra.run.trial028.stdout:(7/7): libnvme-1.16.1-2.el9.x86_64.rpm 171 kB/s | 116 kB 00:00 2026-02-12T10:51:23.185 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:23.185 INFO:teuthology.orchestra.run.trial028.stdout:Total 1.1 MB/s | 2.4 MB 00:02 2026-02-12T10:51:23.200 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:51:23.245 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:51:23.254 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:51:23.254 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:51:23.268 INFO:teuthology.orchestra.run.trial049.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-12T10:51:23.275 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-12T10:51:23.284 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-12T10:51:23.290 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-12T10:51:23.295 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-12T10:51:23.296 INFO:teuthology.orchestra.run.trial049.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-12T10:51:23.317 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:51:23.317 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:51:23.387 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:51:23.426 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-12T10:51:23.428 INFO:teuthology.orchestra.run.trial049.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-12T10:51:23.455 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-12T10:51:23.462 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-12T10:51:23.471 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-12T10:51:23.477 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-12T10:51:23.482 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-12T10:51:23.483 INFO:teuthology.orchestra.run.trial028.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-12T10:51:23.616 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-12T10:51:23.619 INFO:teuthology.orchestra.run.trial028.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-12T10:51:23.689 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-12T10:51:23.689 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T10:51:23.690 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:23.713 INFO:teuthology.orchestra.run.trial049.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:23.903 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-12T10:51:23.903 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T10:51:23.904 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:23.927 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:23.937 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:23.937 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-12T10:51:23.938 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-12T10:51:23.938 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-12T10:51:23.938 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-12T10:51:23.938 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-12T10:51:23.938 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-12T10:51:23.938 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout:Upgraded: 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-12T10:51:23.998 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-12T10:51:23.999 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:23.999 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:51:24.029 DEBUG:teuthology.parallel:result is None 2026-02-12T10:51:24.146 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:24.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-12T10:51:24.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-12T10:51:24.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-12T10:51:24.146 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-12T10:51:24.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-12T10:51:24.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-12T10:51:24.147 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-12T10:51:24.200 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-12T10:51:24.200 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:24.200 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-12T10:51:24.200 INFO:teuthology.orchestra.run.trial028.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-12T10:51:24.200 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:51:24.200 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-12T10:51:24.200 INFO:teuthology.orchestra.run.trial028.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-12T10:51:24.201 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-12T10:51:24.201 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:24.201 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:51:24.232 DEBUG:teuthology.parallel:result is None 2026-02-12T10:51:24.232 INFO:teuthology.run_tasks:Running task install... 2026-02-12T10:51:24.246 DEBUG:teuthology.task.install:project ceph 2026-02-12T10:51:24.246 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'}} 2026-02-12T10:51:24.246 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'} 2026-02-12T10:51:24.246 INFO:teuthology.task.install:Using flavor: default 2026-02-12T10:51:24.254 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T10:51:24.254 INFO:teuthology.task.install:extra packages: [] 2026-02-12T10:51:24.255 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'tag': None, 'wait_for_package': False} 2026-02-12T10:51:24.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:51:24.258 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'tag': None, 'wait_for_package': False} 2026-02-12T10:51:24.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:51:24.260 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'tag': None, 'wait_for_package': False} 2026-02-12T10:51:24.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:51:24.503 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/ 2026-02-12T10:51:24.503 INFO:teuthology.task.install.rpm:Package version is 19.2.3-680.g05b55d19 2026-02-12T10:51:24.505 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/ 2026-02-12T10:51:24.505 INFO:teuthology.task.install.rpm:Package version is 19.2.3-680.g05b55d19 2026-02-12T10:51:24.512 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/ 2026-02-12T10:51:24.512 INFO:teuthology.task.install.rpm:Package version is 19.2.3-680.g05b55d19 2026-02-12T10:51:24.852 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T10:51:24.853 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:51:24.853 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T10:51:24.869 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T10:51:24.869 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:51:24.869 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T10:51:24.882 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T10:51:24.882 DEBUG:teuthology.orchestra.run.trial157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/05b55d192f002ad5df41409624b8d176527d0841/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T10:51:24.898 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T10:51:24.898 DEBUG:teuthology.orchestra.run.trial049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/05b55d192f002ad5df41409624b8d176527d0841/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T10:51:24.914 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T10:51:24.914 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:51:24.914 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T10:51:24.943 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T10:51:24.943 DEBUG:teuthology.orchestra.run.trial028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/05b55d192f002ad5df41409624b8d176527d0841/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T10:51:24.949 DEBUG:teuthology.orchestra.run.trial157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T10:51:24.964 DEBUG:teuthology.orchestra.run.trial049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T10:51:25.010 DEBUG:teuthology.orchestra.run.trial028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T10:51:25.024 DEBUG:teuthology.orchestra.run.trial157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T10:51:25.038 DEBUG:teuthology.orchestra.run.trial049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T10:51:25.085 DEBUG:teuthology.orchestra.run.trial028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T10:51:25.088 INFO:teuthology.orchestra.run.trial157.stdout:check_obsoletes = 1 2026-02-12T10:51:25.089 DEBUG:teuthology.orchestra.run.trial157:> sudo yum clean all 2026-02-12T10:51:25.101 INFO:teuthology.orchestra.run.trial049.stdout:check_obsoletes = 1 2026-02-12T10:51:25.103 DEBUG:teuthology.orchestra.run.trial049:> sudo yum clean all 2026-02-12T10:51:25.148 INFO:teuthology.orchestra.run.trial028.stdout:check_obsoletes = 1 2026-02-12T10:51:25.150 DEBUG:teuthology.orchestra.run.trial028:> sudo yum clean all 2026-02-12T10:51:25.242 INFO:teuthology.orchestra.run.trial157.stdout:41 files removed 2026-02-12T10:51:25.252 INFO:teuthology.orchestra.run.trial049.stdout:41 files removed 2026-02-12T10:51:25.256 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-radosgw 2026-02-12T10:51:25.267 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-radosgw 2026-02-12T10:51:25.299 INFO:teuthology.orchestra.run.trial028.stdout:41 files removed 2026-02-12T10:51:25.313 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-radosgw 2026-02-12T10:51:25.680 INFO:teuthology.orchestra.run.trial049.stdout:ceph packages for x86_64 320 kB/s | 86 kB 00:00 2026-02-12T10:51:25.680 INFO:teuthology.orchestra.run.trial157.stdout:ceph packages for x86_64 310 kB/s | 86 kB 00:00 2026-02-12T10:51:25.688 INFO:teuthology.orchestra.run.trial028.stdout:ceph packages for x86_64 377 kB/s | 86 kB 00:00 2026-02-12T10:51:25.811 INFO:teuthology.orchestra.run.trial049.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-12T10:51:25.812 INFO:teuthology.orchestra.run.trial157.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-12T10:51:25.817 INFO:teuthology.orchestra.run.trial028.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-12T10:51:25.935 INFO:teuthology.orchestra.run.trial049.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-12T10:51:25.937 INFO:teuthology.orchestra.run.trial157.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-12T10:51:25.940 INFO:teuthology.orchestra.run.trial028.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-12T10:51:26.206 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - BaseOS 36 MB/s | 8.9 MB 00:00 2026-02-12T10:51:26.207 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 36 MB/s | 8.9 MB 00:00 2026-02-12T10:51:26.651 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T10:51:27.270 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - AppStream 52 MB/s | 27 MB 00:00 2026-02-12T10:51:29.259 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T10:51:30.052 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 27 MB 00:02 2026-02-12T10:51:30.768 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 7.8 MB 00:01 2026-02-12T10:51:31.705 INFO:teuthology.orchestra.run.trial157.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 20 kB 00:00 2026-02-12T10:51:31.859 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 37 MB/s | 7.8 MB 00:00 2026-02-12T10:51:32.063 INFO:teuthology.orchestra.run.trial157.stdout:Extra Packages for Enterprise Linux 71 MB/s | 20 MB 00:00 2026-02-12T10:51:33.428 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 20 kB 00:00 2026-02-12T10:51:33.836 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 7.8 MB 00:01 2026-02-12T10:51:34.487 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-12T10:51:35.280 INFO:teuthology.orchestra.run.trial157.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-12T10:51:35.596 INFO:teuthology.orchestra.run.trial049.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-12T10:51:36.562 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repository Size 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: ceph-radosgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 11 M 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout:Upgrading: 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: librados2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.4 M 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: librbd1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.2 M 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: ceph-base x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.5 M 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 22 M 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: ceph-selinux x86_64 2:19.2.3-680.g05b55d19.el9 ceph 25 k 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 998 k 2026-02-12T10:51:36.563 INFO:teuthology.orchestra.run.trial157.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: libradosstriper1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 503 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: librgw2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.4 M 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-argparse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 45 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 154 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: python3-cephfs x86_64 2:19.2.3-680.g05b55d19.el9 ceph 165 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: python3-rados x86_64 2:19.2.3-680.g05b55d19.el9 ceph 323 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: python3-rbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 302 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: python3-rgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 100 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout:Installing weak dependencies: 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout:Install 32 Packages 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout:Upgrade 2 Packages 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 62 M 2026-02-12T10:51:36.564 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:51:37.344 INFO:teuthology.orchestra.run.trial157.stdout:(1/34): ceph-radosgw-19.2.3-680.g05b55d19.el9.x 20 MB/s | 11 MB 00:00 2026-02-12T10:51:37.363 INFO:teuthology.orchestra.run.trial157.stdout:(2/34): ceph-selinux-19.2.3-680.g05b55d19.el9.x 1.3 MB/s | 25 kB 00:00 2026-02-12T10:51:37.468 INFO:teuthology.orchestra.run.trial157.stdout:(3/34): libcephfs2-19.2.3-680.g05b55d19.el9.x86 9.3 MB/s | 998 kB 00:00 2026-02-12T10:51:37.564 INFO:teuthology.orchestra.run.trial157.stdout:(4/34): libradosstriper1-19.2.3-680.g05b55d19.e 5.1 MB/s | 503 kB 00:00 2026-02-12T10:51:37.718 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 20 MB 00:02 2026-02-12T10:51:37.749 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T10:51:38.214 INFO:teuthology.orchestra.run.trial157.stdout:(5/34): librgw2-19.2.3-680.g05b55d19.el9.x86_64 8.3 MB/s | 5.4 MB 00:00 2026-02-12T10:51:38.277 INFO:teuthology.orchestra.run.trial157.stdout:(6/34): python3-ceph-argparse-19.2.3-680.g05b55 720 kB/s | 45 kB 00:00 2026-02-12T10:51:38.369 INFO:teuthology.orchestra.run.trial157.stdout:(7/34): python3-ceph-common-19.2.3-680.g05b55d1 1.6 MB/s | 154 kB 00:00 2026-02-12T10:51:38.468 INFO:teuthology.orchestra.run.trial157.stdout:(8/34): python3-cephfs-19.2.3-680.g05b55d19.el9 1.6 MB/s | 165 kB 00:00 2026-02-12T10:51:38.543 INFO:teuthology.orchestra.run.trial157.stdout:(9/34): python3-rados-19.2.3-680.g05b55d19.el9. 4.2 MB/s | 323 kB 00:00 2026-02-12T10:51:38.672 INFO:teuthology.orchestra.run.trial157.stdout:(10/34): python3-rbd-19.2.3-680.g05b55d19.el9.x 2.3 MB/s | 302 kB 00:00 2026-02-12T10:51:38.709 INFO:teuthology.orchestra.run.trial157.stdout:(11/34): ceph-common-19.2.3-680.g05b55d19.el9.x 12 MB/s | 22 MB 00:01 2026-02-12T10:51:38.769 INFO:teuthology.orchestra.run.trial157.stdout:(12/34): python3-rgw-19.2.3-680.g05b55d19.el9.x 1.0 MB/s | 100 kB 00:00 2026-02-12T10:51:38.981 INFO:teuthology.orchestra.run.trial157.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 122 kB/s | 33 kB 00:00 2026-02-12T10:51:39.037 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 11 M 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: librados2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.4 M 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: librbd1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.2 M 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.5 M 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 22 M 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux x86_64 2:19.2.3-680.g05b55d19.el9 ceph 25 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 998 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 503 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: librgw2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.4 M 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 45 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 154 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs x86_64 2:19.2.3-680.g05b55d19.el9 ceph 165 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados x86_64 2:19.2.3-680.g05b55d19.el9 ceph 323 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 302 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 100 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T10:51:39.039 INFO:teuthology.orchestra.run.trial028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout:Install 32 Packages 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 2 Packages 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 62 M 2026-02-12T10:51:39.040 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:51:39.050 INFO:teuthology.orchestra.run.trial157.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 1.5 MB/s | 104 kB 00:00 2026-02-12T10:51:39.115 INFO:teuthology.orchestra.run.trial157.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 2.5 MB/s | 164 kB 00:00 2026-02-12T10:51:39.159 INFO:teuthology.orchestra.run.trial157.stdout:(16/34): pciutils-3.7.0-7.el9.x86_64.rpm 239 kB/s | 93 kB 00:00 2026-02-12T10:51:39.181 INFO:teuthology.orchestra.run.trial157.stdout:(17/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2026-02-12T10:51:39.211 INFO:teuthology.orchestra.run.trial157.stdout:(18/34): ceph-base-19.2.3-680.g05b55d19.el9.x86 2.3 MB/s | 5.5 MB 00:02 2026-02-12T10:51:39.212 INFO:teuthology.orchestra.run.trial157.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 851 kB/s | 45 kB 00:00 2026-02-12T10:51:39.280 INFO:teuthology.orchestra.run.trial157.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 6.6 MB/s | 662 kB 00:00 2026-02-12T10:51:39.287 INFO:teuthology.orchestra.run.trial157.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2026-02-12T10:51:39.289 INFO:teuthology.orchestra.run.trial157.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 3.0 MB/s | 240 kB 00:00 2026-02-12T10:51:39.332 INFO:teuthology.orchestra.run.trial157.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 708 kB/s | 37 kB 00:00 2026-02-12T10:51:39.340 INFO:teuthology.orchestra.run.trial157.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.2 MB/s | 66 kB 00:00 2026-02-12T10:51:39.501 INFO:teuthology.orchestra.run.trial157.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 154 kB/s | 25 kB 00:00 2026-02-12T10:51:39.609 INFO:teuthology.orchestra.run.trial157.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 452 kB/s | 49 kB 00:00 2026-02-12T10:51:39.642 INFO:teuthology.orchestra.run.trial157.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 871 kB/s | 308 kB 00:00 2026-02-12T10:51:39.688 INFO:teuthology.orchestra.run.trial157.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 857 kB/s | 67 kB 00:00 2026-02-12T10:51:39.797 INFO:teuthology.orchestra.run.trial157.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.3 MB/s | 838 kB 00:00 2026-02-12T10:51:39.814 INFO:teuthology.orchestra.run.trial157.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2026-02-12T10:51:39.883 INFO:teuthology.orchestra.run.trial157.stdout:(31/34): libarrow-9.0.0-15.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2026-02-12T10:51:39.921 INFO:teuthology.orchestra.run.trial157.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-12T10:51:40.152 INFO:teuthology.orchestra.run.trial157.stdout:(33/34): librbd1-19.2.3-680.g05b55d19.el9.x86_6 12 MB/s | 3.2 MB 00:00 2026-02-12T10:51:40.202 INFO:teuthology.orchestra.run.trial028.stdout:(1/34): ceph-base-19.2.3-680.g05b55d19.el9.x86_ 8.2 MB/s | 5.5 MB 00:00 2026-02-12T10:51:40.219 INFO:teuthology.orchestra.run.trial028.stdout:(2/34): ceph-selinux-19.2.3-680.g05b55d19.el9.x 1.4 MB/s | 25 kB 00:00 2026-02-12T10:51:40.281 INFO:teuthology.orchestra.run.trial028.stdout:(3/34): libcephfs2-19.2.3-680.g05b55d19.el9.x86 16 MB/s | 998 kB 00:00 2026-02-12T10:51:40.313 INFO:teuthology.orchestra.run.trial028.stdout:(4/34): libradosstriper1-19.2.3-680.g05b55d19.e 15 MB/s | 503 kB 00:00 2026-02-12T10:51:40.330 INFO:teuthology.orchestra.run.trial157.stdout:(34/34): librados2-19.2.3-680.g05b55d19.el9.x86 6.7 MB/s | 3.4 MB 00:00 2026-02-12T10:51:40.332 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:40.332 INFO:teuthology.orchestra.run.trial157.stdout:Total 16 MB/s | 62 MB 00:03 2026-02-12T10:51:40.421 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:51:40.441 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:51:40.441 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:51:40.497 INFO:teuthology.orchestra.run.trial028.stdout:(5/34): ceph-radosgw-19.2.3-680.g05b55d19.el9.x 11 MB/s | 11 MB 00:00 2026-02-12T10:51:40.517 INFO:teuthology.orchestra.run.trial028.stdout:(6/34): python3-ceph-argparse-19.2.3-680.g05b55 2.2 MB/s | 45 kB 00:00 2026-02-12T10:51:40.547 INFO:teuthology.orchestra.run.trial028.stdout:(7/34): python3-ceph-common-19.2.3-680.g05b55d1 5.0 MB/s | 154 kB 00:00 2026-02-12T10:51:40.579 INFO:teuthology.orchestra.run.trial028.stdout:(8/34): python3-cephfs-19.2.3-680.g05b55d19.el9 5.1 MB/s | 165 kB 00:00 2026-02-12T10:51:40.591 INFO:teuthology.orchestra.run.trial028.stdout:(9/34): librgw2-19.2.3-680.g05b55d19.el9.x86_64 20 MB/s | 5.4 MB 00:00 2026-02-12T10:51:40.602 INFO:teuthology.orchestra.run.trial028.stdout:(10/34): python3-rados-19.2.3-680.g05b55d19.el9 14 MB/s | 323 kB 00:00 2026-02-12T10:51:40.618 INFO:teuthology.orchestra.run.trial028.stdout:(11/34): python3-rbd-19.2.3-680.g05b55d19.el9.x 11 MB/s | 302 kB 00:00 2026-02-12T10:51:40.625 INFO:teuthology.orchestra.run.trial028.stdout:(12/34): python3-rgw-19.2.3-680.g05b55d19.el9.x 4.3 MB/s | 100 kB 00:00 2026-02-12T10:51:40.648 INFO:teuthology.orchestra.run.trial028.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 1.1 MB/s | 33 kB 00:00 2026-02-12T10:51:40.658 INFO:teuthology.orchestra.run.trial028.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 2.7 MB/s | 93 kB 00:00 2026-02-12T10:51:40.671 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:51:40.671 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:51:40.758 INFO:teuthology.orchestra.run.trial028.stdout:(15/34): ceph-common-19.2.3-680.g05b55d19.el9.x 18 MB/s | 22 MB 00:01 2026-02-12T10:51:40.926 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T10:51:40.958 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:51:40.967 INFO:teuthology.orchestra.run.trial157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T10:51:40.969 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-12T10:51:40.981 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-12T10:51:41.130 INFO:teuthology.orchestra.run.trial157.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-12T10:51:41.136 INFO:teuthology.orchestra.run.trial157.stdout: Upgrading : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:41.166 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:41.209 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-12T10:51:41.210 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:41.222 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:41.226 INFO:teuthology.orchestra.run.trial157.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-12T10:51:41.236 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 9/36 2026-02-12T10:51:41.258 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-12T10:51:41.259 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:41.274 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:41.310 INFO:teuthology.orchestra.run.trial157.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-12T10:51:41.314 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-12T10:51:41.320 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-12T10:51:41.322 INFO:teuthology.orchestra.run.trial157.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-12T10:51:41.325 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-12T10:51:41.330 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-12T10:51:41.342 INFO:teuthology.orchestra.run.trial028.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 150 kB/s | 104 kB 00:00 2026-02-12T10:51:41.377 INFO:teuthology.orchestra.run.trial028.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 228 kB/s | 164 kB 00:00 2026-02-12T10:51:41.469 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T10:51:41.471 INFO:teuthology.orchestra.run.trial157.stdout: Upgrading : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-12T10:51:41.496 INFO:teuthology.orchestra.run.trial028.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 294 kB/s | 45 kB 00:00 2026-02-12T10:51:41.499 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-12T10:51:41.502 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 20/36 2026-02-12T10:51:41.508 INFO:teuthology.orchestra.run.trial157.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T10:51:41.517 INFO:teuthology.orchestra.run.trial028.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 211 kB/s | 160 kB 00:00 2026-02-12T10:51:41.733 INFO:teuthology.orchestra.run.trial157.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T10:51:41.734 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-12T10:51:41.750 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-12T10:51:41.756 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 24/36 2026-02-12T10:51:41.761 INFO:teuthology.orchestra.run.trial157.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T10:51:41.763 INFO:teuthology.orchestra.run.trial157.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T10:51:41.764 INFO:teuthology.orchestra.run.trial157.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T10:51:41.782 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T10:51:41.785 INFO:teuthology.orchestra.run.trial157.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T10:51:41.815 INFO:teuthology.orchestra.run.trial157.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T10:51:41.817 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 30/36 2026-02-12T10:51:41.895 INFO:teuthology.orchestra.run.trial028.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 634 kB/s | 240 kB 00:00 2026-02-12T10:51:41.955 INFO:teuthology.orchestra.run.trial028.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 636 kB/s | 292 kB 00:00 2026-02-12T10:51:42.048 INFO:teuthology.orchestra.run.trial028.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 242 kB/s | 37 kB 00:00 2026-02-12T10:51:42.108 INFO:teuthology.orchestra.run.trial028.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 434 kB/s | 66 kB 00:00 2026-02-12T10:51:42.216 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 11 M 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout:Upgrading: 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: librados2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.4 M 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: librbd1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.2 M 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.5 M 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 22 M 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: ceph-selinux x86_64 2:19.2.3-680.g05b55d19.el9 ceph 25 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 998 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: libradosstriper1 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 503 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: librgw2 x86_64 2:19.2.3-680.g05b55d19.el9 ceph 5.4 M 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-argparse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 45 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-common x86_64 2:19.2.3-680.g05b55d19.el9 ceph 154 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs x86_64 2:19.2.3-680.g05b55d19.el9 ceph 165 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados x86_64 2:19.2.3-680.g05b55d19.el9 ceph 323 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 302 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw x86_64 2:19.2.3-680.g05b55d19.el9 ceph 100 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T10:51:42.218 INFO:teuthology.orchestra.run.trial049.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout:Install 32 Packages 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout:Upgrade 2 Packages 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 62 M 2026-02-12T10:51:42.219 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:51:42.221 INFO:teuthology.orchestra.run.trial028.stdout:(24/34): librdkafka-1.6.1-102.el9.x86_64.rpm 785 kB/s | 662 kB 00:00 2026-02-12T10:51:42.283 INFO:teuthology.orchestra.run.trial028.stdout:(25/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.3 MB/s | 308 kB 00:00 2026-02-12T10:51:42.321 INFO:teuthology.orchestra.run.trial028.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-12T10:51:42.331 INFO:teuthology.orchestra.run.trial028.stdout:(27/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 224 kB/s | 25 kB 00:00 2026-02-12T10:51:42.361 INFO:teuthology.orchestra.run.trial028.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-12T10:51:42.410 INFO:teuthology.orchestra.run.trial028.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2026-02-12T10:51:42.485 INFO:teuthology.orchestra.run.trial028.stdout:(30/34): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-12T10:51:42.538 INFO:teuthology.orchestra.run.trial028.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-12T10:51:42.539 INFO:teuthology.orchestra.run.trial028.stdout:(32/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2026-02-12T10:51:42.700 INFO:teuthology.orchestra.run.trial028.stdout:(33/34): librados2-19.2.3-680.g05b55d19.el9.x86 16 MB/s | 3.4 MB 00:00 2026-02-12T10:51:42.795 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:42.798 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:42.809 INFO:teuthology.orchestra.run.trial049.stdout:(1/34): ceph-base-19.2.3-680.g05b55d19.el9.x86_ 15 MB/s | 5.5 MB 00:00 2026-02-12T10:51:42.841 INFO:teuthology.orchestra.run.trial049.stdout:(2/34): ceph-selinux-19.2.3-680.g05b55d19.el9.x 804 kB/s | 25 kB 00:00 2026-02-12T10:51:42.893 INFO:teuthology.orchestra.run.trial049.stdout:(3/34): libcephfs2-19.2.3-680.g05b55d19.el9.x86 19 MB/s | 998 kB 00:00 2026-02-12T10:51:42.936 INFO:teuthology.orchestra.run.trial049.stdout:(4/34): libradosstriper1-19.2.3-680.g05b55d19.e 11 MB/s | 503 kB 00:00 2026-02-12T10:51:43.080 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:43.083 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-12T10:51:43.125 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-12T10:51:43.125 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T10:51:43.125 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T10:51:43.125 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:43.128 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:43.206 INFO:teuthology.orchestra.run.trial049.stdout:(5/34): ceph-radosgw-19.2.3-680.g05b55d19.el9.x 14 MB/s | 11 MB 00:00 2026-02-12T10:51:43.226 INFO:teuthology.orchestra.run.trial049.stdout:(6/34): librgw2-19.2.3-680.g05b55d19.el9.x86_64 19 MB/s | 5.4 MB 00:00 2026-02-12T10:51:43.233 INFO:teuthology.orchestra.run.trial049.stdout:(7/34): python3-ceph-argparse-19.2.3-680.g05b55 1.6 MB/s | 45 kB 00:00 2026-02-12T10:51:43.257 INFO:teuthology.orchestra.run.trial049.stdout:(8/34): python3-ceph-common-19.2.3-680.g05b55d1 4.8 MB/s | 154 kB 00:00 2026-02-12T10:51:43.265 INFO:teuthology.orchestra.run.trial049.stdout:(9/34): python3-cephfs-19.2.3-680.g05b55d19.el9 5.0 MB/s | 165 kB 00:00 2026-02-12T10:51:43.294 INFO:teuthology.orchestra.run.trial049.stdout:(10/34): python3-rados-19.2.3-680.g05b55d19.el9 8.7 MB/s | 323 kB 00:00 2026-02-12T10:51:43.304 INFO:teuthology.orchestra.run.trial049.stdout:(11/34): python3-rbd-19.2.3-680.g05b55d19.el9.x 7.6 MB/s | 302 kB 00:00 2026-02-12T10:51:43.330 INFO:teuthology.orchestra.run.trial049.stdout:(12/34): python3-rgw-19.2.3-680.g05b55d19.el9.x 2.7 MB/s | 100 kB 00:00 2026-02-12T10:51:43.377 INFO:teuthology.orchestra.run.trial049.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.9 MB/s | 93 kB 00:00 2026-02-12T10:51:43.414 INFO:teuthology.orchestra.run.trial049.stdout:(14/34): ceph-common-19.2.3-680.g05b55d19.el9.x 23 MB/s | 22 MB 00:00 2026-02-12T10:51:43.485 INFO:teuthology.orchestra.run.trial049.stdout:(15/34): mailcap-2.1.49-5.el9.noarch.rpm 183 kB/s | 33 kB 00:00 2026-02-12T10:51:43.532 INFO:teuthology.orchestra.run.trial028.stdout:(34/34): librbd1-19.2.3-680.g05b55d19.el9.x86_6 3.2 MB/s | 3.2 MB 00:00 2026-02-12T10:51:43.536 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:43.536 INFO:teuthology.orchestra.run.trial028.stdout:Total 14 MB/s | 62 MB 00:04 2026-02-12T10:51:43.537 INFO:teuthology.orchestra.run.trial049.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 648 kB/s | 104 kB 00:00 2026-02-12T10:51:43.554 INFO:teuthology.orchestra.run.trial049.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 1.2 MB/s | 164 kB 00:00 2026-02-12T10:51:43.568 INFO:teuthology.orchestra.run.trial049.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 45 kB 00:00 2026-02-12T10:51:43.622 INFO:teuthology.orchestra.run.trial049.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2026-02-12T10:51:43.624 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:51:43.636 INFO:teuthology.orchestra.run.trial049.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 7.9 MB/s | 662 kB 00:00 2026-02-12T10:51:43.637 INFO:teuthology.orchestra.run.trial049.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 292 kB 00:00 2026-02-12T10:51:43.641 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:51:43.641 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:51:43.662 INFO:teuthology.orchestra.run.trial049.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-12T10:51:43.662 INFO:teuthology.orchestra.run.trial049.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.6 MB/s | 66 kB 00:00 2026-02-12T10:51:43.677 INFO:teuthology.orchestra.run.trial049.stdout:(24/34): qatlib-25.08.0-2.el9.x86_64.rpm 4.3 MB/s | 240 kB 00:00 2026-02-12T10:51:43.752 INFO:teuthology.orchestra.run.trial049.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 334 kB/s | 25 kB 00:00 2026-02-12T10:51:43.802 INFO:teuthology.orchestra.run.trial049.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 978 kB/s | 49 kB 00:00 2026-02-12T10:51:43.825 INFO:teuthology.orchestra.run.trial049.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.8 MB/s | 308 kB 00:00 2026-02-12T10:51:43.839 INFO:teuthology.orchestra.run.trial049.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.8 MB/s | 67 kB 00:00 2026-02-12T10:51:43.870 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:51:43.871 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:51:43.895 INFO:teuthology.orchestra.run.trial049.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-12T10:51:43.897 INFO:teuthology.orchestra.run.trial049.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2026-02-12T10:51:43.952 INFO:teuthology.orchestra.run.trial049.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 28 MB/s | 1.6 MB 00:00 2026-02-12T10:51:43.966 INFO:teuthology.orchestra.run.trial049.stdout:(32/34): librados2-19.2.3-680.g05b55d19.el9.x86 50 MB/s | 3.4 MB 00:00 2026-02-12T10:51:44.022 INFO:teuthology.orchestra.run.trial049.stdout:(33/34): librbd1-19.2.3-680.g05b55d19.el9.x86_6 46 MB/s | 3.2 MB 00:00 2026-02-12T10:51:44.063 INFO:teuthology.orchestra.run.trial049.stdout:(34/34): libarrow-9.0.0-15.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2026-02-12T10:51:44.066 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:44.066 INFO:teuthology.orchestra.run.trial049.stdout:Total 33 MB/s | 62 MB 00:01 2026-02-12T10:51:44.156 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:51:44.157 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:51:44.165 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T10:51:44.167 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-12T10:51:44.174 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:51:44.174 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:51:44.179 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-12T10:51:44.330 INFO:teuthology.orchestra.run.trial028.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-12T10:51:44.334 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:44.365 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:44.403 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:51:44.403 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:51:44.407 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-12T10:51:44.408 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:44.421 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:44.425 INFO:teuthology.orchestra.run.trial028.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-12T10:51:44.434 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 9/36 2026-02-12T10:51:44.457 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-12T10:51:44.457 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:44.471 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:44.503 INFO:teuthology.orchestra.run.trial028.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-12T10:51:44.507 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-12T10:51:44.513 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-12T10:51:44.515 INFO:teuthology.orchestra.run.trial028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-12T10:51:44.518 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-12T10:51:44.523 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-12T10:51:44.664 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T10:51:44.666 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-12T10:51:44.687 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:51:44.693 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-12T10:51:44.696 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T10:51:44.696 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 20/36 2026-02-12T10:51:44.698 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-12T10:51:44.703 INFO:teuthology.orchestra.run.trial028.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T10:51:44.710 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-12T10:51:44.861 INFO:teuthology.orchestra.run.trial049.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-12T10:51:44.865 INFO:teuthology.orchestra.run.trial049.stdout: Upgrading : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:44.892 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:44.932 INFO:teuthology.orchestra.run.trial028.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T10:51:44.933 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-12T10:51:44.935 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-12T10:51:44.936 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:44.946 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:44.950 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-12T10:51:44.951 INFO:teuthology.orchestra.run.trial049.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-12T10:51:44.954 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 24/36 2026-02-12T10:51:44.958 INFO:teuthology.orchestra.run.trial028.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T10:51:44.960 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T10:51:44.961 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 9/36 2026-02-12T10:51:44.961 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T10:51:44.979 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T10:51:44.982 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T10:51:44.985 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-12T10:51:44.986 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:45.000 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:45.011 INFO:teuthology.orchestra.run.trial028.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T10:51:45.013 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 30/36 2026-02-12T10:51:45.034 INFO:teuthology.orchestra.run.trial049.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-12T10:51:45.038 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-12T10:51:45.046 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-12T10:51:45.048 INFO:teuthology.orchestra.run.trial049.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-12T10:51:45.053 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-12T10:51:45.058 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-12T10:51:45.198 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T10:51:45.199 INFO:teuthology.orchestra.run.trial049.stdout: Upgrading : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-12T10:51:45.226 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 19/36 2026-02-12T10:51:45.228 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 20/36 2026-02-12T10:51:45.235 INFO:teuthology.orchestra.run.trial049.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T10:51:45.460 INFO:teuthology.orchestra.run.trial049.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T10:51:45.461 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-12T10:51:45.478 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 23/36 2026-02-12T10:51:45.482 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 24/36 2026-02-12T10:51:45.487 INFO:teuthology.orchestra.run.trial049.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T10:51:45.490 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T10:51:45.491 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T10:51:45.509 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T10:51:45.511 INFO:teuthology.orchestra.run.trial049.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T10:51:45.540 INFO:teuthology.orchestra.run.trial049.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T10:51:45.542 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 30/36 2026-02-12T10:51:45.995 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:45.997 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:46.279 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:46.282 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-12T10:51:46.321 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-12T10:51:46.321 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T10:51:46.321 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T10:51:46.321 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:46.325 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:46.519 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:46.522 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:46.804 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 31/36 2026-02-12T10:51:46.807 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-12T10:51:46.847 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 32/36 2026-02-12T10:51:46.847 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T10:51:46.847 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T10:51:46.847 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:46.851 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:47.645 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /sys 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /proc 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /mnt 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /var/tmp 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /home 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /root 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout:skipping the directory /tmp 2026-02-12T10:51:47.646 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:48.100 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-12T10:51:48.124 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-12T10:51:48.124 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:51:48.124 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T10:51:48.124 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T10:51:48.124 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T10:51:48.125 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:48.126 INFO:teuthology.orchestra.run.trial157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T10:51:48.138 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T10:51:48.138 INFO:teuthology.orchestra.run.trial157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:48.195 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:48.195 INFO:teuthology.orchestra.run.trial157.stdout:Creating group 'qat' with GID 992. 2026-02-12T10:51:48.195 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:48.457 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 1/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 3/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 4/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 8/36 2026-02-12T10:51:48.458 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 9/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 12/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 13/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T10:51:48.459 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T10:51:48.460 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T10:51:48.461 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T10:51:48.461 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T10:51:48.461 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:48.461 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T10:51:48.461 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 35/36 2026-02-12T10:51:48.517 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:48.517 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:48.517 INFO:teuthology.orchestra.run.trial157.stdout:Upgraded: 2026-02-12T10:51:48.517 INFO:teuthology.orchestra.run.trial157.stdout: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.517 INFO:teuthology.orchestra.run.trial157.stdout: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.517 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:51:48.517 INFO:teuthology.orchestra.run.trial157.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T10:51:48.518 INFO:teuthology.orchestra.run.trial157.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T10:51:48.519 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T10:51:48.520 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:48.521 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:51:48.558 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-test 2026-02-12T10:51:48.861 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:13 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:51:48.944 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repository Size 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout: ceph-test x86_64 2:19.2.3-680.g05b55d19.el9 ceph 50 M 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout: libcephsqlite x86_64 2:19.2.3-680.g05b55d19.el9 ceph 163 k 2026-02-12T10:51:48.945 INFO:teuthology.orchestra.run.trial157.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout:Install 5 Packages 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 50 M 2026-02-12T10:51:48.946 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 212 M 2026-02-12T10:51:48.947 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:51:49.369 INFO:teuthology.orchestra.run.trial157.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.9 MB/s | 233 kB 00:00 2026-02-12T10:51:49.388 INFO:teuthology.orchestra.run.trial157.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 16 MB/s | 303 kB 00:00 2026-02-12T10:51:49.397 INFO:teuthology.orchestra.run.trial157.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 6.5 MB/s | 64 kB 00:00 2026-02-12T10:51:49.444 INFO:teuthology.orchestra.run.trial157.stdout:(4/5): libcephsqlite-19.2.3-680.g05b55d19.el9.x 1.2 MB/s | 163 kB 00:00 2026-02-12T10:51:50.528 INFO:teuthology.orchestra.run.trial157.stdout:(5/5): ceph-test-19.2.3-680.g05b55d19.el9.x86_6 41 MB/s | 50 MB 00:01 2026-02-12T10:51:50.530 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:50.530 INFO:teuthology.orchestra.run.trial157.stdout:Total 32 MB/s | 50 MB 00:01 2026-02-12T10:51:50.557 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:51:50.567 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:51:50.567 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:51:50.753 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:51:50.754 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:51:50.825 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:50.825 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /sys 2026-02-12T10:51:50.825 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /proc 2026-02-12T10:51:50.825 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /mnt 2026-02-12T10:51:50.825 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /var/tmp 2026-02-12T10:51:50.826 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /home 2026-02-12T10:51:50.826 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /root 2026-02-12T10:51:50.826 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /tmp 2026-02-12T10:51:50.826 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:50.965 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:51:50.971 INFO:teuthology.orchestra.run.trial157.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-12T10:51:50.975 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-12T10:51:50.983 INFO:teuthology.orchestra.run.trial157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-12T10:51:50.984 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-12T10:51:51.282 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-12T10:51:51.305 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-12T10:51:51.306 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:51:51.306 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T10:51:51.306 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T10:51:51.306 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T10:51:51.306 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:51.307 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T10:51:51.321 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T10:51:51.321 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /sys 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /proc 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /mnt 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /var/tmp 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /home 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /root 2026-02-12T10:51:51.377 INFO:teuthology.orchestra.run.trial049.stdout:skipping the directory /tmp 2026-02-12T10:51:51.378 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:51.379 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:51.379 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'qat' with GID 992. 2026-02-12T10:51:51.379 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:51.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 1/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 3/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 4/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 8/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 9/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-12T10:51:51.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 12/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 13/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T10:51:51.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T10:51:51.646 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 35/36 2026-02-12T10:51:51.702 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.703 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.704 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.705 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:51.706 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T10:51:51.706 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T10:51:51.706 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T10:51:51.706 INFO:teuthology.orchestra.run.trial028.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T10:51:51.706 INFO:teuthology.orchestra.run.trial028.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T10:51:51.706 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:51.706 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:51:51.745 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-test 2026-02-12T10:51:51.827 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-12T10:51:51.851 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 34/36 2026-02-12T10:51:51.851 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:51:51.851 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T10:51:51.852 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T10:51:51.852 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T10:51:51.852 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:51.853 INFO:teuthology.orchestra.run.trial049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T10:51:51.866 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T10:51:51.866 INFO:teuthology.orchestra.run.trial049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:51.922 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:51.922 INFO:teuthology.orchestra.run.trial049.stdout:Creating group 'qat' with GID 992. 2026-02-12T10:51:51.923 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:52.045 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:15 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:51:52.127 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:51:52.128 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:52.128 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-12T10:51:52.128 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:52.128 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:51:52.128 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test x86_64 2:19.2.3-680.g05b55d19.el9 ceph 50 M 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite x86_64 2:19.2.3-680.g05b55d19.el9 ceph 163 k 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout:Install 5 Packages 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 50 M 2026-02-12T10:51:52.129 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 212 M 2026-02-12T10:51:52.130 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 1/36 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2/36 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 3/36 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 4/36 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 5/36 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 6/36 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 7/36 2026-02-12T10:51:52.186 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x 8/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86 9/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 10/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 11/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 12/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 13/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T10:51:52.187 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados2-2:19.2.3-680.g05b55d19.el9.x86_64 33/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T10:51:52.188 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 35/36 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout:Upgraded: 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout: librados2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout: librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T10:51:52.249 INFO:teuthology.orchestra.run.trial049.stdout: ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: ceph-radosgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: ceph-selinux-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: libradosstriper1-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.250 INFO:teuthology.orchestra.run.trial049.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: librgw2-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-argparse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: python3-ceph-common-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.251 INFO:teuthology.orchestra.run.trial049.stdout: python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:52.252 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T10:51:52.252 INFO:teuthology.orchestra.run.trial049.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T10:51:52.252 INFO:teuthology.orchestra.run.trial049.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T10:51:52.252 INFO:teuthology.orchestra.run.trial049.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T10:51:52.252 INFO:teuthology.orchestra.run.trial049.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T10:51:52.252 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:52.252 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:51:52.275 INFO:teuthology.orchestra.run.trial028.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.0 MB/s | 233 kB 00:00 2026-02-12T10:51:52.289 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-test 2026-02-12T10:51:52.293 INFO:teuthology.orchestra.run.trial028.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 17 MB/s | 303 kB 00:00 2026-02-12T10:51:52.302 INFO:teuthology.orchestra.run.trial028.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.2 MB/s | 64 kB 00:00 2026-02-12T10:51:52.306 INFO:teuthology.orchestra.run.trial028.stdout:(4/5): libcephsqlite-19.2.3-680.g05b55d19.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-12T10:51:52.591 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:12 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test x86_64 2:19.2.3-680.g05b55d19.el9 ceph 50 M 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: libcephsqlite x86_64 2:19.2.3-680.g05b55d19.el9 ceph 163 k 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout:Install 5 Packages 2026-02-12T10:51:52.675 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:52.676 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 50 M 2026-02-12T10:51:52.676 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 212 M 2026-02-12T10:51:52.676 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:51:53.115 INFO:teuthology.orchestra.run.trial049.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 614 kB/s | 233 kB 00:00 2026-02-12T10:51:53.143 INFO:teuthology.orchestra.run.trial049.stdout:(2/5): libcephsqlite-19.2.3-680.g05b55d19.el9.x 400 kB/s | 163 kB 00:00 2026-02-12T10:51:53.234 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-12T10:51:53.236 INFO:teuthology.orchestra.run.trial028.stdout:(5/5): ceph-test-19.2.3-680.g05b55d19.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-12T10:51:53.237 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:53.237 INFO:teuthology.orchestra.run.trial028.stdout:Total 45 MB/s | 50 MB 00:01 2026-02-12T10:51:53.252 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-12T10:51:53.266 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:51:53.274 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:51:53.274 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:51:53.459 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:51:53.460 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:51:53.467 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-12T10:51:53.467 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 1/5 2026-02-12T10:51:53.467 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2/5 2026-02-12T10:51:53.467 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-12T10:51:53.467 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-12T10:51:53.524 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-12T10:51:53.524 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:53.524 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:51:53.524 INFO:teuthology.orchestra.run.trial157.stdout: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:53.524 INFO:teuthology.orchestra.run.trial157.stdout: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:53.525 INFO:teuthology.orchestra.run.trial157.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T10:51:53.525 INFO:teuthology.orchestra.run.trial157.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T10:51:53.525 INFO:teuthology.orchestra.run.trial157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T10:51:53.525 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:53.525 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:51:53.556 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph 2026-02-12T10:51:53.674 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:51:53.680 INFO:teuthology.orchestra.run.trial028.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-12T10:51:53.684 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-12T10:51:53.692 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-12T10:51:53.693 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-12T10:51:53.858 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:18 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:51:53.927 INFO:teuthology.orchestra.run.trial049.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 373 kB/s | 303 kB 00:00 2026-02-12T10:51:53.941 INFO:teuthology.orchestra.run.trial049.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 80 kB/s | 64 kB 00:00 2026-02-12T10:51:53.944 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:51:53.947 INFO:teuthology.orchestra.run.trial157.stdout:====================================================================================== 2026-02-12T10:51:53.947 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repository Size 2026-02-12T10:51:53.947 INFO:teuthology.orchestra.run.trial157.stdout:====================================================================================== 2026-02-12T10:51:53.947 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:51:53.947 INFO:teuthology.orchestra.run.trial157.stdout: ceph x86_64 2:19.2.3-680.g05b55d19.el9 ceph 6.5 k 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout:Installing dependencies: 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: ceph-grafana-dashboards noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 31 k 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mds x86_64 2:19.2.3-680.g05b55d19.el9 ceph 2.4 M 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.1 M 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-modules-core noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 253 k 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mon x86_64 2:19.2.3-680.g05b55d19.el9 ceph 4.7 M 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: ceph-osd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 17 M 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: ceph-prometheus-alerts noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 17 k 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 769 k 2026-02-12T10:51:53.948 INFO:teuthology.orchestra.run.trial157.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T10:51:53.949 INFO:teuthology.orchestra.run.trial157.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T10:51:53.950 INFO:teuthology.orchestra.run.trial157.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T10:51:53.951 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T10:51:53.952 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T10:51:53.953 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T10:51:53.954 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout:Installing weak dependencies: 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 150 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-dashboard noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 3.8 M 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 7.4 M 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 22 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-rook noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 49 k 2026-02-12T10:51:53.955 INFO:teuthology.orchestra.run.trial157.stdout: ceph-volume noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 298 k 2026-02-12T10:51:53.956 INFO:teuthology.orchestra.run.trial157.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T10:51:53.956 INFO:teuthology.orchestra.run.trial157.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T10:51:53.956 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:53.956 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:51:53.956 INFO:teuthology.orchestra.run.trial157.stdout:====================================================================================== 2026-02-12T10:51:53.956 INFO:teuthology.orchestra.run.trial157.stdout:Install 98 Packages 2026-02-12T10:51:53.956 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:51:53.957 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 95 M 2026-02-12T10:51:53.957 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 519 M 2026-02-12T10:51:53.957 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:51:54.081 INFO:teuthology.orchestra.run.trial049.stdout:(5/5): ceph-test-19.2.3-680.g05b55d19.el9.x86_6 37 MB/s | 50 MB 00:01 2026-02-12T10:51:54.082 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:54.083 INFO:teuthology.orchestra.run.trial049.stdout:Total 36 MB/s | 50 MB 00:01 2026-02-12T10:51:54.109 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:51:54.118 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:51:54.118 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:51:54.304 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:51:54.304 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:51:54.515 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:51:54.521 INFO:teuthology.orchestra.run.trial049.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-12T10:51:54.525 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-12T10:51:54.533 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-12T10:51:54.534 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-12T10:51:54.930 INFO:teuthology.orchestra.run.trial157.stdout:(1/98): ceph-19.2.3-680.g05b55d19.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2026-02-12T10:51:55.095 INFO:teuthology.orchestra.run.trial157.stdout:(2/98): ceph-mgr-19.2.3-680.g05b55d19.el9.x86_6 3.6 MB/s | 1.1 MB 00:00 2026-02-12T10:51:55.187 INFO:teuthology.orchestra.run.trial157.stdout:(3/98): ceph-mon-19.2.3-680.g05b55d19.el9.x86_6 18 MB/s | 4.7 MB 00:00 2026-02-12T10:51:55.236 INFO:teuthology.orchestra.run.trial157.stdout:(4/98): ceph-mds-19.2.3-680.g05b55d19.el9.x86_6 5.6 MB/s | 2.4 MB 00:00 2026-02-12T10:51:55.288 INFO:teuthology.orchestra.run.trial157.stdout:(5/98): ceph-grafana-dashboards-19.2.3-680.g05b 305 kB/s | 31 kB 00:00 2026-02-12T10:51:55.325 INFO:teuthology.orchestra.run.trial157.stdout:(6/98): ceph-mgr-cephadm-19.2.3-680.g05b55d19.e 1.6 MB/s | 150 kB 00:00 2026-02-12T10:51:55.461 INFO:teuthology.orchestra.run.trial157.stdout:(7/98): ceph-mgr-dashboard-19.2.3-680.g05b55d19 22 MB/s | 3.8 MB 00:00 2026-02-12T10:51:55.841 INFO:teuthology.orchestra.run.trial157.stdout:(8/98): ceph-osd-19.2.3-680.g05b55d19.el9.x86_6 23 MB/s | 17 MB 00:00 2026-02-12T10:51:55.877 INFO:teuthology.orchestra.run.trial157.stdout:(9/98): ceph-mgr-modules-core-19.2.3-680.g05b55 6.8 MB/s | 253 kB 00:00 2026-02-12T10:51:55.904 INFO:teuthology.orchestra.run.trial157.stdout:(10/98): ceph-mgr-rook-19.2.3-680.g05b55d19.el9 1.8 MB/s | 49 kB 00:00 2026-02-12T10:51:55.934 INFO:teuthology.orchestra.run.trial157.stdout:(11/98): ceph-prometheus-alerts-19.2.3-680.g05b 564 kB/s | 17 kB 00:00 2026-02-12T10:51:55.937 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-12T10:51:55.955 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-12T10:51:55.988 INFO:teuthology.orchestra.run.trial157.stdout:(12/98): ceph-mgr-diskprediction-local-19.2.3-6 11 MB/s | 7.4 MB 00:00 2026-02-12T10:51:56.006 INFO:teuthology.orchestra.run.trial157.stdout:(13/98): ceph-mgr-k8sevents-19.2.3-680.g05b55d1 40 kB/s | 22 kB 00:00 2026-02-12T10:51:56.007 INFO:teuthology.orchestra.run.trial157.stdout:(14/98): ceph-volume-19.2.3-680.g05b55d19.el9.n 4.0 MB/s | 298 kB 00:00 2026-02-12T10:51:56.021 INFO:teuthology.orchestra.run.trial157.stdout:(15/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 2.9 MB/s | 40 kB 00:00 2026-02-12T10:51:56.029 INFO:teuthology.orchestra.run.trial157.stdout:(16/98): libconfig-1.7.2-9.el9.x86_64.rpm 9.3 MB/s | 72 kB 00:00 2026-02-12T10:51:56.032 INFO:teuthology.orchestra.run.trial157.stdout:(17/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 13 MB/s | 350 kB 00:00 2026-02-12T10:51:56.037 INFO:teuthology.orchestra.run.trial157.stdout:(18/98): libquadmath-11.5.0-14.el9.x86_64.rpm 31 MB/s | 184 kB 00:00 2026-02-12T10:51:56.043 INFO:teuthology.orchestra.run.trial157.stdout:(19/98): libgfortran-11.5.0-14.el9.x86_64.rpm 57 MB/s | 794 kB 00:00 2026-02-12T10:51:56.047 INFO:teuthology.orchestra.run.trial157.stdout:(20/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 28 MB/s | 253 kB 00:00 2026-02-12T10:51:56.052 INFO:teuthology.orchestra.run.trial157.stdout:(21/98): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-12T10:51:56.057 INFO:teuthology.orchestra.run.trial157.stdout:(22/98): python3-cryptography-36.0.1-5.el9.x86_ 87 MB/s | 1.2 MB 00:00 2026-02-12T10:51:56.058 INFO:teuthology.orchestra.run.trial157.stdout:(23/98): cephadm-19.2.3-680.g05b55d19.el9.noarc 11 MB/s | 769 kB 00:00 2026-02-12T10:51:56.059 INFO:teuthology.orchestra.run.trial157.stdout:(24/98): python3-pycparser-2.20-6.el9.noarch.rp 21 MB/s | 135 kB 00:00 2026-02-12T10:51:56.064 INFO:teuthology.orchestra.run.trial157.stdout:(25/98): python3-requests-2.25.1-10.el9.noarch. 17 MB/s | 126 kB 00:00 2026-02-12T10:51:56.065 INFO:teuthology.orchestra.run.trial157.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 30 MB/s | 182 kB 00:00 2026-02-12T10:51:56.069 INFO:teuthology.orchestra.run.trial157.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 57 MB/s | 266 kB 00:00 2026-02-12T10:51:56.080 INFO:teuthology.orchestra.run.trial157.stdout:(28/98): python3-urllib3-1.26.5-7.el9.noarch.rp 10 MB/s | 218 kB 00:00 2026-02-12T10:51:56.151 INFO:teuthology.orchestra.run.trial157.stdout:(29/98): flexiblas-3.0.4-8.el9.x86_64.rpm 382 kB/s | 33 kB 00:00 2026-02-12T10:51:56.152 INFO:teuthology.orchestra.run.trial157.stdout:(30/98): flexiblas-openblas-openmp-3.0.4-8.el9. 251 kB/s | 18 kB 00:00 2026-02-12T10:51:56.177 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-12T10:51:56.177 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 1/5 2026-02-12T10:51:56.177 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2/5 2026-02-12T10:51:56.177 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-12T10:51:56.177 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:56.230 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:51:56.248 INFO:teuthology.orchestra.run.trial157.stdout:(31/98): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 188 kB 00:00 2026-02-12T10:51:56.249 INFO:teuthology.orchestra.run.trial157.stdout:(32/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.5 MB/s | 246 kB 00:00 2026-02-12T10:51:56.263 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph 2026-02-12T10:51:56.275 INFO:teuthology.orchestra.run.trial157.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-12T10:51:56.311 INFO:teuthology.orchestra.run.trial157.stdout:(34/98): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 12 MB/s | 3.0 MB 00:00 2026-02-12T10:51:56.361 INFO:teuthology.orchestra.run.trial157.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2026-02-12T10:51:56.384 INFO:teuthology.orchestra.run.trial157.stdout:(36/98): python3-babel-2.9.1-2.el9.noarch.rpm 82 MB/s | 6.0 MB 00:00 2026-02-12T10:51:56.389 INFO:teuthology.orchestra.run.trial157.stdout:(37/98): python3-devel-3.9.25-2.el9.x86_64.rpm 8.5 MB/s | 244 kB 00:00 2026-02-12T10:51:56.411 INFO:teuthology.orchestra.run.trial157.stdout:(38/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.9 MB/s | 249 kB 00:00 2026-02-12T10:51:56.422 INFO:teuthology.orchestra.run.trial157.stdout:(39/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 31 MB/s | 5.3 MB 00:00 2026-02-12T10:51:56.422 INFO:teuthology.orchestra.run.trial157.stdout:(40/98): python3-libstoragemgmt-1.10.1-1.el9.x8 5.2 MB/s | 177 kB 00:00 2026-02-12T10:51:56.441 INFO:teuthology.orchestra.run.trial157.stdout:(41/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 41 MB/s | 1.2 MB 00:00 2026-02-12T10:51:56.448 INFO:teuthology.orchestra.run.trial157.stdout:(42/98): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-12T10:51:56.449 INFO:teuthology.orchestra.run.trial157.stdout:(43/98): python3-mako-1.1.4-6.el9.noarch.rpm 6.1 MB/s | 172 kB 00:00 2026-02-12T10:51:56.476 INFO:teuthology.orchestra.run.trial157.stdout:(44/98): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-12T10:51:56.478 INFO:teuthology.orchestra.run.trial157.stdout:(45/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 14 MB/s | 442 kB 00:00 2026-02-12T10:51:56.508 INFO:teuthology.orchestra.run.trial157.stdout:(46/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 93 MB/s | 6.1 MB 00:00 2026-02-12T10:51:56.508 INFO:teuthology.orchestra.run.trial157.stdout:(47/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.1 MB/s | 159 kB 00:00 2026-02-12T10:51:56.509 INFO:teuthology.orchestra.run.trial157.stdout:(48/98): python3-protobuf-3.14.0-17.el9.noarch. 7.8 MB/s | 267 kB 00:00 2026-02-12T10:51:56.534 INFO:teuthology.orchestra.run.trial157.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 2.1 MB/s | 54 kB 00:00 2026-02-12T10:51:56.535 INFO:teuthology.orchestra.run.trial157.stdout:(50/98): python3-pyasn1-modules-0.4.8-6.el9.noa 9.9 MB/s | 279 kB 00:00 2026-02-12T10:51:56.559 INFO:teuthology.orchestra.run.trial157.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-12T10:51:56.562 INFO:teuthology.orchestra.run.trial157.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.0 MB/s | 189 kB 00:00 2026-02-12T10:51:56.562 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:19 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:51:56.585 INFO:teuthology.orchestra.run.trial157.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.5 MB/s | 90 kB 00:00 2026-02-12T10:51:56.610 INFO:teuthology.orchestra.run.trial157.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 464 kB/s | 22 kB 00:00 2026-02-12T10:51:56.649 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:51:56.651 INFO:teuthology.orchestra.run.trial028.stdout:====================================================================================== 2026-02-12T10:51:56.651 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout:====================================================================================== 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph x86_64 2:19.2.3-680.g05b55d19.el9 ceph 6.5 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 31 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds x86_64 2:19.2.3-680.g05b55d19.el9 ceph 2.4 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.1 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 253 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon x86_64 2:19.2.3-680.g05b55d19.el9 ceph 4.7 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 17 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 17 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 769 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T10:51:56.652 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T10:51:56.653 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 150 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 3.8 M 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 7.4 M 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 22 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 49 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 298 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout:====================================================================================== 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout:Install 98 Packages 2026-02-12T10:51:56.654 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:51:56.655 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 95 M 2026-02-12T10:51:56.655 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 519 M 2026-02-12T10:51:56.655 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:51:56.711 INFO:teuthology.orchestra.run.trial157.stdout:(55/98): protobuf-compiler-3.14.0-17.el9.x86_64 6.7 MB/s | 862 kB 00:00 2026-02-12T10:51:56.778 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 4/5 2026-02-12T10:51:56.780 INFO:teuthology.orchestra.run.trial157.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 285 kB/s | 19 kB 00:00 2026-02-12T10:51:56.791 INFO:teuthology.orchestra.run.trial157.stdout:(57/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.0 MB/s | 551 kB 00:00 2026-02-12T10:51:56.796 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-12T10:51:56.845 INFO:teuthology.orchestra.run.trial157.stdout:(58/98): python3-asyncssh-2.13.2-5.el9.noarch.r 9.9 MB/s | 548 kB 00:00 2026-02-12T10:51:56.848 INFO:teuthology.orchestra.run.trial157.stdout:(59/98): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2026-02-12T10:51:56.870 INFO:teuthology.orchestra.run.trial157.stdout:(60/98): python3-autocommand-2.2.2-8.el9.noarch 1.2 MB/s | 29 kB 00:00 2026-02-12T10:51:56.872 INFO:teuthology.orchestra.run.trial157.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 2.5 MB/s | 60 kB 00:00 2026-02-12T10:51:56.895 INFO:teuthology.orchestra.run.trial157.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2026-02-12T10:51:56.895 INFO:teuthology.orchestra.run.trial157.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 1.4 MB/s | 32 kB 00:00 2026-02-12T10:51:56.919 INFO:teuthology.orchestra.run.trial157.stdout:(64/98): python3-cheroot-10.0.1-4.el9.noarch.rp 7.3 MB/s | 173 kB 00:00 2026-02-12T10:51:56.946 INFO:teuthology.orchestra.run.trial157.stdout:(65/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 44 MB/s | 19 MB 00:00 2026-02-12T10:51:56.947 INFO:teuthology.orchestra.run.trial157.stdout:(66/98): python3-certifi-2023.05.07-4.el9.noarc 273 kB/s | 14 kB 00:00 2026-02-12T10:51:56.948 INFO:teuthology.orchestra.run.trial157.stdout:(67/98): python3-cherrypy-18.6.1-2.el9.noarch.r 12 MB/s | 358 kB 00:00 2026-02-12T10:51:56.972 INFO:teuthology.orchestra.run.trial157.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 6.1 MB/s | 144 kB 00:00 2026-02-12T10:51:56.972 INFO:teuthology.orchestra.run.trial157.stdout:(69/98): python3-google-auth-2.45.0-1.el9.noarc 9.5 MB/s | 254 kB 00:00 2026-02-12T10:51:56.995 INFO:teuthology.orchestra.run.trial157.stdout:(70/98): python3-influxdb-5.3.1-1.el9.noarch.rp 5.9 MB/s | 139 kB 00:00 2026-02-12T10:51:56.997 INFO:teuthology.orchestra.run.trial157.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 2.2 MB/s | 56 kB 00:00 2026-02-12T10:51:57.007 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 5/5 2026-02-12T10:51:57.007 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 1/5 2026-02-12T10:51:57.007 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2/5 2026-02-12T10:51:57.007 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-12T10:51:57.007 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-12T10:51:57.018 INFO:teuthology.orchestra.run.trial157.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 473 kB/s | 11 kB 00:00 2026-02-12T10:51:57.021 INFO:teuthology.orchestra.run.trial157.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 731 kB/s | 18 kB 00:00 2026-02-12T10:51:57.040 INFO:teuthology.orchestra.run.trial157.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 1.0 MB/s | 23 kB 00:00 2026-02-12T10:51:57.046 INFO:teuthology.orchestra.run.trial157.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 818 kB/s | 20 kB 00:00 2026-02-12T10:51:57.060 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout: ceph-test-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout: libcephsqlite-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:57.061 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:51:57.063 INFO:teuthology.orchestra.run.trial157.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 857 kB/s | 19 kB 00:00 2026-02-12T10:51:57.070 INFO:teuthology.orchestra.run.trial157.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 1.1 MB/s | 26 kB 00:00 2026-02-12T10:51:57.093 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph 2026-02-12T10:51:57.097 INFO:teuthology.orchestra.run.trial157.stdout:(78/98): python3-logutils-0.3.5-21.el9.noarch.r 1.7 MB/s | 46 kB 00:00 2026-02-12T10:51:57.110 INFO:teuthology.orchestra.run.trial157.stdout:(79/98): python3-kubernetes-26.1.0-3.el9.noarch 22 MB/s | 1.0 MB 00:00 2026-02-12T10:51:57.122 INFO:teuthology.orchestra.run.trial157.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2026-02-12T10:51:57.133 INFO:teuthology.orchestra.run.trial157.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.7 MB/s | 86 kB 00:00 2026-02-12T10:51:57.147 INFO:teuthology.orchestra.run.trial157.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2026-02-12T10:51:57.163 INFO:teuthology.orchestra.run.trial157.stdout:(83/98): python3-pecan-1.4.2-3.el9.noarch.rpm 8.9 MB/s | 272 kB 00:00 2026-02-12T10:51:57.172 INFO:teuthology.orchestra.run.trial157.stdout:(84/98): python3-portend-3.1.0-2.el9.noarch.rpm 680 kB/s | 16 kB 00:00 2026-02-12T10:51:57.185 INFO:teuthology.orchestra.run.trial157.stdout:(85/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.6 MB/s | 2.0 MB 00:00 2026-02-12T10:51:57.186 INFO:teuthology.orchestra.run.trial157.stdout:(86/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.8 MB/s | 90 kB 00:00 2026-02-12T10:51:57.196 INFO:teuthology.orchestra.run.trial157.stdout:(87/98): python3-repoze-lru-0.7-16.el9.noarch.r 1.2 MB/s | 31 kB 00:00 2026-02-12T10:51:57.208 INFO:teuthology.orchestra.run.trial157.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2026-02-12T10:51:57.215 INFO:teuthology.orchestra.run.trial157.stdout:(89/98): python3-routes-2.5.1-5.el9.noarch.rpm 6.1 MB/s | 188 kB 00:00 2026-02-12T10:51:57.222 INFO:teuthology.orchestra.run.trial157.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 4.7 MB/s | 125 kB 00:00 2026-02-12T10:51:57.231 INFO:teuthology.orchestra.run.trial157.stdout:(91/98): python3-tempora-5.0.0-2.el9.noarch.rpm 1.5 MB/s | 36 kB 00:00 2026-02-12T10:51:57.244 INFO:teuthology.orchestra.run.trial157.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 2.9 MB/s | 86 kB 00:00 2026-02-12T10:51:57.253 INFO:teuthology.orchestra.run.trial157.stdout:(93/98): python3-webob-1.8.8-2.el9.noarch.rpm 7.3 MB/s | 230 kB 00:00 2026-02-12T10:51:57.254 INFO:teuthology.orchestra.run.trial157.stdout:(94/98): python3-websocket-client-1.2.3-2.el9.n 3.9 MB/s | 90 kB 00:00 2026-02-12T10:51:57.277 INFO:teuthology.orchestra.run.trial157.stdout:(95/98): python3-xmltodict-0.12.0-15.el9.noarch 978 kB/s | 22 kB 00:00 2026-02-12T10:51:57.278 INFO:teuthology.orchestra.run.trial157.stdout:(96/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.9 MB/s | 48 kB 00:00 2026-02-12T10:51:57.280 INFO:teuthology.orchestra.run.trial157.stdout:(97/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 11 MB/s | 427 kB 00:00 2026-02-12T10:51:57.281 INFO:teuthology.orchestra.run.trial028.stdout:(1/98): ceph-19.2.3-680.g05b55d19.el9.x86_64.rp 51 kB/s | 6.5 kB 00:00 2026-02-12T10:51:57.300 INFO:teuthology.orchestra.run.trial157.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 881 kB/s | 20 kB 00:00 2026-02-12T10:51:57.300 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:51:57.301 INFO:teuthology.orchestra.run.trial157.stdout:Total 28 MB/s | 95 MB 00:03 2026-02-12T10:51:57.391 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:17 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:51:57.400 INFO:teuthology.orchestra.run.trial028.stdout:(2/98): ceph-mgr-19.2.3-680.g05b55d19.el9.x86_6 4.4 MB/s | 1.1 MB 00:00 2026-02-12T10:51:57.447 INFO:teuthology.orchestra.run.trial028.stdout:(3/98): ceph-mds-19.2.3-680.g05b55d19.el9.x86_6 8.3 MB/s | 2.4 MB 00:00 2026-02-12T10:51:57.479 INFO:teuthology.orchestra.run.trial028.stdout:(4/98): ceph-grafana-dashboards-19.2.3-680.g05b 954 kB/s | 31 kB 00:00 2026-02-12T10:51:57.480 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:51:57.482 INFO:teuthology.orchestra.run.trial049.stdout:====================================================================================== 2026-02-12T10:51:57.482 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repository Size 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout:====================================================================================== 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout: ceph x86_64 2:19.2.3-680.g05b55d19.el9 ceph 6.5 k 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout: ceph-grafana-dashboards noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 31 k 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds x86_64 2:19.2.3-680.g05b55d19.el9 ceph 2.4 M 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.1 M 2026-02-12T10:51:57.483 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-modules-core noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 253 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon x86_64 2:19.2.3-680.g05b55d19.el9 ceph 4.7 M 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 17 M 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: ceph-prometheus-alerts noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 17 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 769 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T10:51:57.484 INFO:teuthology.orchestra.run.trial049.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T10:51:57.485 INFO:teuthology.orchestra.run.trial049.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T10:51:57.486 INFO:teuthology.orchestra.run.trial049.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T10:51:57.487 INFO:teuthology.orchestra.run.trial049.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-12T10:51:57.488 INFO:teuthology.orchestra.run.trial049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T10:51:57.489 INFO:teuthology.orchestra.run.trial049.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T10:51:57.490 INFO:teuthology.orchestra.run.trial049.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout:Installing weak dependencies: 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-cephadm noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 150 k 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-dashboard noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 3.8 M 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 7.4 M 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 22 k 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-rook noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 49 k 2026-02-12T10:51:57.491 INFO:teuthology.orchestra.run.trial049.stdout: ceph-volume noarch 2:19.2.3-680.g05b55d19.el9 ceph-noarch 298 k 2026-02-12T10:51:57.492 INFO:teuthology.orchestra.run.trial049.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T10:51:57.492 INFO:teuthology.orchestra.run.trial049.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T10:51:57.492 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:57.492 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:51:57.492 INFO:teuthology.orchestra.run.trial049.stdout:====================================================================================== 2026-02-12T10:51:57.492 INFO:teuthology.orchestra.run.trial049.stdout:Install 98 Packages 2026-02-12T10:51:57.492 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:51:57.493 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 95 M 2026-02-12T10:51:57.493 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 519 M 2026-02-12T10:51:57.493 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:51:57.523 INFO:teuthology.orchestra.run.trial028.stdout:(5/98): ceph-mgr-cephadm-19.2.3-680.g05b55d19.e 3.4 MB/s | 150 kB 00:00 2026-02-12T10:51:57.667 INFO:teuthology.orchestra.run.trial028.stdout:(6/98): ceph-mon-19.2.3-680.g05b55d19.el9.x86_6 12 MB/s | 4.7 MB 00:00 2026-02-12T10:51:57.724 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:51:57.763 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:51:57.763 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:51:57.766 INFO:teuthology.orchestra.run.trial028.stdout:(7/98): ceph-mgr-dashboard-19.2.3-680.g05b55d19 16 MB/s | 3.8 MB 00:00 2026-02-12T10:51:57.819 INFO:teuthology.orchestra.run.trial028.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-680.g05b55d19 418 kB/s | 22 kB 00:00 2026-02-12T10:51:57.864 INFO:teuthology.orchestra.run.trial028.stdout:(9/98): ceph-mgr-modules-core-19.2.3-680.g05b55 5.6 MB/s | 253 kB 00:00 2026-02-12T10:51:57.906 INFO:teuthology.orchestra.run.trial028.stdout:(10/98): ceph-mgr-rook-19.2.3-680.g05b55d19.el9 1.2 MB/s | 49 kB 00:00 2026-02-12T10:51:57.941 INFO:teuthology.orchestra.run.trial028.stdout:(11/98): ceph-prometheus-alerts-19.2.3-680.g05b 471 kB/s | 17 kB 00:00 2026-02-12T10:51:57.984 INFO:teuthology.orchestra.run.trial028.stdout:(12/98): ceph-volume-19.2.3-680.g05b55d19.el9.n 6.8 MB/s | 298 kB 00:00 2026-02-12T10:51:58.039 INFO:teuthology.orchestra.run.trial028.stdout:(13/98): cephadm-19.2.3-680.g05b55d19.el9.noarc 14 MB/s | 769 kB 00:00 2026-02-12T10:51:58.145 INFO:teuthology.orchestra.run.trial028.stdout:(14/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.2 MB/s | 350 kB 00:00 2026-02-12T10:51:58.172 INFO:teuthology.orchestra.run.trial028.stdout:(15/98): ceph-mgr-diskprediction-local-19.2.3-6 15 MB/s | 7.4 MB 00:00 2026-02-12T10:51:58.172 INFO:teuthology.orchestra.run.trial028.stdout:(16/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-12T10:51:58.180 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:51:58.181 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:51:58.195 INFO:teuthology.orchestra.run.trial049.stdout:(1/98): ceph-19.2.3-680.g05b55d19.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2026-02-12T10:51:58.217 INFO:teuthology.orchestra.run.trial028.stdout:(17/98): libgfortran-11.5.0-14.el9.x86_64.rpm 17 MB/s | 794 kB 00:00 2026-02-12T10:51:58.235 INFO:teuthology.orchestra.run.trial028.stdout:(18/98): libconfig-1.7.2-9.el9.x86_64.rpm 1.1 MB/s | 72 kB 00:00 2026-02-12T10:51:58.242 INFO:teuthology.orchestra.run.trial028.stdout:(19/98): libquadmath-11.5.0-14.el9.x86_64.rpm 7.3 MB/s | 184 kB 00:00 2026-02-12T10:51:58.269 INFO:teuthology.orchestra.run.trial028.stdout:(20/98): python3-cryptography-36.0.1-5.el9.x86_ 46 MB/s | 1.2 MB 00:00 2026-02-12T10:51:58.293 INFO:teuthology.orchestra.run.trial028.stdout:(21/98): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-12T10:51:58.299 INFO:teuthology.orchestra.run.trial028.stdout:(22/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.8 MB/s | 253 kB 00:00 2026-02-12T10:51:58.316 INFO:teuthology.orchestra.run.trial028.stdout:(23/98): python3-pycparser-2.20-6.el9.noarch.rp 5.9 MB/s | 135 kB 00:00 2026-02-12T10:51:58.323 INFO:teuthology.orchestra.run.trial028.stdout:(24/98): python3-requests-2.25.1-10.el9.noarch. 5.2 MB/s | 126 kB 00:00 2026-02-12T10:51:58.340 INFO:teuthology.orchestra.run.trial028.stdout:(25/98): python3-urllib3-1.26.5-7.el9.noarch.rp 8.8 MB/s | 218 kB 00:00 2026-02-12T10:51:58.347 INFO:teuthology.orchestra.run.trial028.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-12T10:51:58.364 INFO:teuthology.orchestra.run.trial028.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-12T10:51:58.413 INFO:teuthology.orchestra.run.trial028.stdout:(28/98): flexiblas-3.0.4-8.el9.x86_64.rpm 493 kB/s | 33 kB 00:00 2026-02-12T10:51:58.415 INFO:teuthology.orchestra.run.trial049.stdout:(2/98): ceph-mgr-19.2.3-680.g05b55d19.el9.x86_6 3.1 MB/s | 1.1 MB 00:00 2026-02-12T10:51:58.438 INFO:teuthology.orchestra.run.trial028.stdout:(29/98): flexiblas-openblas-openmp-3.0.4-8.el9. 737 kB/s | 18 kB 00:00 2026-02-12T10:51:58.525 INFO:teuthology.orchestra.run.trial028.stdout:(30/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.8 MB/s | 246 kB 00:00 2026-02-12T10:51:58.553 INFO:teuthology.orchestra.run.trial028.stdout:(31/98): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-12T10:51:58.553 INFO:teuthology.orchestra.run.trial028.stdout:(32/98): lua-5.4.4-4.el9.x86_64.rpm 6.5 MB/s | 188 kB 00:00 2026-02-12T10:51:58.574 INFO:teuthology.orchestra.run.trial028.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-12T10:51:58.583 INFO:teuthology.orchestra.run.trial049.stdout:(3/98): ceph-mds-19.2.3-680.g05b55d19.el9.x86_6 4.7 MB/s | 2.4 MB 00:00 2026-02-12T10:51:58.597 INFO:teuthology.orchestra.run.trial028.stdout:(34/98): protobuf-3.14.0-17.el9.x86_64.rpm 44 MB/s | 1.0 MB 00:00 2026-02-12T10:51:58.618 INFO:teuthology.orchestra.run.trial049.stdout:(4/98): ceph-grafana-dashboards-19.2.3-680.g05b 896 kB/s | 31 kB 00:00 2026-02-12T10:51:58.631 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:51:58.633 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-12T10:51:58.648 INFO:teuthology.orchestra.run.trial049.stdout:(5/98): ceph-mgr-cephadm-19.2.3-680.g05b55d19.e 4.9 MB/s | 150 kB 00:00 2026-02-12T10:51:58.651 INFO:teuthology.orchestra.run.trial028.stdout:(35/98): ceph-osd-19.2.3-680.g05b55d19.el9.x86_ 14 MB/s | 17 MB 00:01 2026-02-12T10:51:58.664 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-12T10:51:58.669 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-12T10:51:58.691 INFO:teuthology.orchestra.run.trial157.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-12T10:51:58.702 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-12T10:51:58.707 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-12T10:51:58.740 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-12T10:51:58.750 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-12T10:51:58.755 INFO:teuthology.orchestra.run.trial157.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-12T10:51:58.757 INFO:teuthology.orchestra.run.trial157.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-12T10:51:58.759 INFO:teuthology.orchestra.run.trial028.stdout:(36/98): python3-babel-2.9.1-2.el9.noarch.rpm 37 MB/s | 6.0 MB 00:00 2026-02-12T10:51:58.762 INFO:teuthology.orchestra.run.trial157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 11/98 2026-02-12T10:51:58.781 INFO:teuthology.orchestra.run.trial028.stdout:(37/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 11 MB/s | 249 kB 00:00 2026-02-12T10:51:58.785 INFO:teuthology.orchestra.run.trial157.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-12T10:51:58.786 INFO:teuthology.orchestra.run.trial028.stdout:(38/98): python3-devel-3.9.25-2.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2026-02-12T10:51:58.798 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-12T10:51:58.801 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-12T10:51:58.805 INFO:teuthology.orchestra.run.trial028.stdout:(39/98): python3-libstoragemgmt-1.10.1-1.el9.x8 7.3 MB/s | 177 kB 00:00 2026-02-12T10:51:58.807 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-12T10:51:58.809 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-12T10:51:58.820 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-12T10:51:58.826 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-12T10:51:58.850 INFO:teuthology.orchestra.run.trial157.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-12T10:51:58.854 INFO:teuthology.orchestra.run.trial157.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-12T10:51:58.861 INFO:teuthology.orchestra.run.trial157.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-12T10:51:58.875 INFO:teuthology.orchestra.run.trial028.stdout:(40/98): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 172 kB 00:00 2026-02-12T10:51:58.885 INFO:teuthology.orchestra.run.trial157.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-12T10:51:58.896 INFO:teuthology.orchestra.run.trial028.stdout:(41/98): python3-markupsafe-1.1.1-12.el9.x86_64 1.6 MB/s | 35 kB 00:00 2026-02-12T10:51:58.907 INFO:teuthology.orchestra.run.trial028.stdout:(42/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2026-02-12T10:51:58.932 INFO:teuthology.orchestra.run.trial028.stdout:(43/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 18 MB/s | 442 kB 00:00 2026-02-12T10:51:58.937 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-12T10:51:58.950 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-12T10:51:58.953 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-12T10:51:58.953 INFO:teuthology.orchestra.run.trial028.stdout:(44/98): python3-packaging-20.9-5.el9.noarch.rp 3.6 MB/s | 77 kB 00:00 2026-02-12T10:51:58.957 INFO:teuthology.orchestra.run.trial157.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-12T10:51:58.963 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-12T10:51:58.967 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-12T10:51:58.971 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-12T10:51:58.985 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-12T10:51:58.988 INFO:teuthology.orchestra.run.trial049.stdout:(6/98): ceph-mgr-dashboard-19.2.3-680.g05b55d19 11 MB/s | 3.8 MB 00:00 2026-02-12T10:51:59.007 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-12T10:51:59.011 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-12T10:51:59.016 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-12T10:51:59.028 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-12T10:51:59.037 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-12T10:51:59.038 INFO:teuthology.orchestra.run.trial028.stdout:(45/98): python3-protobuf-3.14.0-17.el9.noarch. 3.1 MB/s | 267 kB 00:00 2026-02-12T10:51:59.043 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-12T10:51:59.062 INFO:teuthology.orchestra.run.trial028.stdout:(46/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.5 MB/s | 159 kB 00:00 2026-02-12T10:51:59.063 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-12T10:51:59.072 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-12T10:51:59.088 INFO:teuthology.orchestra.run.trial028.stdout:(47/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 32 MB/s | 6.1 MB 00:00 2026-02-12T10:51:59.089 INFO:teuthology.orchestra.run.trial028.stdout:(48/98): python3-pyasn1-modules-0.4.8-6.el9.noa 9.9 MB/s | 279 kB 00:00 2026-02-12T10:51:59.110 INFO:teuthology.orchestra.run.trial028.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 2.4 MB/s | 54 kB 00:00 2026-02-12T10:51:59.127 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-12T10:51:59.139 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-12T10:51:59.155 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-12T10:51:59.160 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-12T10:51:59.168 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-12T10:51:59.201 INFO:teuthology.orchestra.run.trial028.stdout:(50/98): python3-toml-0.10.2-6.el9.noarch.rpm 457 kB/s | 42 kB 00:00 2026-02-12T10:51:59.208 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-12T10:51:59.224 INFO:teuthology.orchestra.run.trial028.stdout:(51/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.3 MB/s | 189 kB 00:00 2026-02-12T10:51:59.294 INFO:teuthology.orchestra.run.trial028.stdout:(52/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.3 MB/s | 90 kB 00:00 2026-02-12T10:51:59.362 INFO:teuthology.orchestra.run.trial028.stdout:(53/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 6.5 MB/s | 5.3 MB 00:00 2026-02-12T10:51:59.363 INFO:teuthology.orchestra.run.trial028.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 322 kB/s | 22 kB 00:00 2026-02-12T10:51:59.483 INFO:teuthology.orchestra.run.trial028.stdout:(55/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 49 MB/s | 19 MB 00:00 2026-02-12T10:51:59.494 INFO:teuthology.orchestra.run.trial028.stdout:(56/98): protobuf-compiler-3.14.0-17.el9.x86_64 6.4 MB/s | 862 kB 00:00 2026-02-12T10:51:59.537 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-12T10:51:59.547 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-12T10:51:59.551 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-12T10:51:59.557 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-12T10:51:59.559 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-12T10:51:59.581 INFO:teuthology.orchestra.run.trial028.stdout:(57/98): grpc-data-1.46.7-10.el9.noarch.rpm 198 kB/s | 19 kB 00:00 2026-02-12T10:51:59.586 INFO:teuthology.orchestra.run.trial157.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-12T10:51:59.605 INFO:teuthology.orchestra.run.trial049.stdout:(7/98): ceph-mon-19.2.3-680.g05b55d19.el9.x86_6 3.4 MB/s | 4.7 MB 00:01 2026-02-12T10:51:59.615 INFO:teuthology.orchestra.run.trial028.stdout:(58/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.1 MB/s | 551 kB 00:00 2026-02-12T10:51:59.630 INFO:teuthology.orchestra.run.trial157.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-12T10:51:59.637 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-12T10:51:59.640 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-12T10:51:59.644 INFO:teuthology.orchestra.run.trial049.stdout:(8/98): ceph-mgr-diskprediction-local-19.2.3-68 11 MB/s | 7.4 MB 00:00 2026-02-12T10:51:59.646 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-12T10:51:59.650 INFO:teuthology.orchestra.run.trial028.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 844 kB/s | 29 kB 00:00 2026-02-12T10:51:59.650 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-12T10:51:59.652 INFO:teuthology.orchestra.run.trial049.stdout:(9/98): ceph-mgr-k8sevents-19.2.3-680.g05b55d19 469 kB/s | 22 kB 00:00 2026-02-12T10:51:59.657 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-12T10:51:59.660 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-12T10:51:59.677 INFO:teuthology.orchestra.run.trial028.stdout:(60/98): luarocks-3.9.2-5.el9.noarch.rpm 825 kB/s | 151 kB 00:00 2026-02-12T10:51:59.682 INFO:teuthology.orchestra.run.trial049.stdout:(10/98): ceph-mgr-modules-core-19.2.3-680.g05b5 6.5 MB/s | 253 kB 00:00 2026-02-12T10:51:59.685 INFO:teuthology.orchestra.run.trial028.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 1.7 MB/s | 60 kB 00:00 2026-02-12T10:51:59.687 INFO:teuthology.orchestra.run.trial049.stdout:(11/98): ceph-mgr-rook-19.2.3-680.g05b55d19.el9 1.4 MB/s | 49 kB 00:00 2026-02-12T10:51:59.689 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-12T10:51:59.699 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-12T10:51:59.716 INFO:teuthology.orchestra.run.trial028.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-12T10:51:59.718 INFO:teuthology.orchestra.run.trial049.stdout:(12/98): ceph-prometheus-alerts-19.2.3-680.g05b 460 kB/s | 17 kB 00:00 2026-02-12T10:51:59.719 INFO:teuthology.orchestra.run.trial028.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 957 kB/s | 32 kB 00:00 2026-02-12T10:51:59.727 INFO:teuthology.orchestra.run.trial049.stdout:(13/98): ceph-volume-19.2.3-680.g05b55d19.el9.n 7.3 MB/s | 298 kB 00:00 2026-02-12T10:51:59.734 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-12T10:51:59.751 INFO:teuthology.orchestra.run.trial028.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 410 kB/s | 14 kB 00:00 2026-02-12T10:51:59.758 INFO:teuthology.orchestra.run.trial028.stdout:(65/98): python3-asyncssh-2.13.2-5.el9.noarch.r 3.0 MB/s | 548 kB 00:00 2026-02-12T10:51:59.759 INFO:teuthology.orchestra.run.trial028.stdout:(66/98): python3-cheroot-10.0.1-4.el9.noarch.rp 4.3 MB/s | 173 kB 00:00 2026-02-12T10:51:59.771 INFO:teuthology.orchestra.run.trial049.stdout:(14/98): cephadm-19.2.3-680.g05b55d19.el9.noarc 14 MB/s | 769 kB 00:00 2026-02-12T10:51:59.800 INFO:teuthology.orchestra.run.trial028.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 5.8 MB/s | 254 kB 00:00 2026-02-12T10:51:59.837 INFO:teuthology.orchestra.run.trial028.stdout:(68/98): python3-cherrypy-18.6.1-2.el9.noarch.r 4.0 MB/s | 358 kB 00:00 2026-02-12T10:51:59.839 INFO:teuthology.orchestra.run.trial028.stdout:(69/98): python3-grpcio-tools-1.46.7-10.el9.x86 3.7 MB/s | 144 kB 00:00 2026-02-12T10:51:59.864 INFO:teuthology.orchestra.run.trial028.stdout:(70/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 19 MB/s | 2.0 MB 00:00 2026-02-12T10:51:59.874 INFO:teuthology.orchestra.run.trial028.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 1.6 MB/s | 56 kB 00:00 2026-02-12T10:51:59.876 INFO:teuthology.orchestra.run.trial049.stdout:(15/98): ceph-osd-19.2.3-680.g05b55d19.el9.x86_ 12 MB/s | 17 MB 00:01 2026-02-12T10:51:59.878 INFO:teuthology.orchestra.run.trial028.stdout:(72/98): python3-influxdb-5.3.1-1.el9.noarch.rp 3.4 MB/s | 139 kB 00:00 2026-02-12T10:51:59.898 INFO:teuthology.orchestra.run.trial028.stdout:(73/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 315 kB/s | 11 kB 00:00 2026-02-12T10:51:59.904 INFO:teuthology.orchestra.run.trial049.stdout:(16/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 1.9 MB/s | 350 kB 00:00 2026-02-12T10:51:59.907 INFO:teuthology.orchestra.run.trial028.stdout:(74/98): python3-jaraco-classes-3.2.1-5.el9.noa 527 kB/s | 18 kB 00:00 2026-02-12T10:51:59.911 INFO:teuthology.orchestra.run.trial028.stdout:(75/98): python3-jaraco-collections-3.0.0-8.el9 692 kB/s | 23 kB 00:00 2026-02-12T10:51:59.932 INFO:teuthology.orchestra.run.trial028.stdout:(76/98): python3-jaraco-context-6.0.1-3.el9.noa 586 kB/s | 20 kB 00:00 2026-02-12T10:51:59.941 INFO:teuthology.orchestra.run.trial028.stdout:(77/98): python3-jaraco-functools-3.5.0-2.el9.n 583 kB/s | 19 kB 00:00 2026-02-12T10:51:59.945 INFO:teuthology.orchestra.run.trial028.stdout:(78/98): python3-jaraco-text-4.0.0-2.el9.noarch 782 kB/s | 26 kB 00:00 2026-02-12T10:51:59.961 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-12T10:51:59.974 INFO:teuthology.orchestra.run.trial049.stdout:(17/98): libgfortran-11.5.0-14.el9.x86_64.rpm 11 MB/s | 794 kB 00:00 2026-02-12T10:51:59.980 INFO:teuthology.orchestra.run.trial028.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 1.2 MB/s | 46 kB 00:00 2026-02-12T10:51:59.982 INFO:teuthology.orchestra.run.trial028.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 2.1 MB/s | 79 kB 00:00 2026-02-12T10:51:59.985 INFO:teuthology.orchestra.run.trial049.stdout:(18/98): libconfig-1.7.2-9.el9.x86_64.rpm 660 kB/s | 72 kB 00:00 2026-02-12T10:51:59.986 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-12T10:51:59.986 INFO:teuthology.orchestra.run.trial028.stdout:(81/98): python3-kubernetes-26.1.0-3.el9.noarch 19 MB/s | 1.0 MB 00:00 2026-02-12T10:51:59.990 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-12T10:52:00.002 INFO:teuthology.orchestra.run.trial049.stdout:(19/98): libquadmath-11.5.0-14.el9.x86_64.rpm 6.5 MB/s | 184 kB 00:00 2026-02-12T10:52:00.016 INFO:teuthology.orchestra.run.trial028.stdout:(82/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.4 MB/s | 86 kB 00:00 2026-02-12T10:52:00.018 INFO:teuthology.orchestra.run.trial028.stdout:(83/98): python3-natsort-7.1.1-5.el9.noarch.rpm 1.6 MB/s | 58 kB 00:00 2026-02-12T10:52:00.022 INFO:teuthology.orchestra.run.trial028.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 7.2 MB/s | 272 kB 00:00 2026-02-12T10:52:00.049 INFO:teuthology.orchestra.run.trial157.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-12T10:52:00.049 INFO:teuthology.orchestra.run.trial028.stdout:(85/98): python3-portend-3.1.0-2.el9.noarch.rpm 490 kB/s | 16 kB 00:00 2026-02-12T10:52:00.050 INFO:teuthology.orchestra.run.trial157.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-12T10:52:00.054 INFO:teuthology.orchestra.run.trial049.stdout:(20/98): python3-cryptography-36.0.1-5.el9.x86_ 24 MB/s | 1.2 MB 00:00 2026-02-12T10:52:00.055 INFO:teuthology.orchestra.run.trial028.stdout:(86/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.4 MB/s | 90 kB 00:00 2026-02-12T10:52:00.056 INFO:teuthology.orchestra.run.trial028.stdout:(87/98): python3-repoze-lru-0.7-16.el9.noarch.r 911 kB/s | 31 kB 00:00 2026-02-12T10:52:00.063 INFO:teuthology.orchestra.run.trial049.stdout:(21/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 253 kB 00:00 2026-02-12T10:52:00.072 INFO:teuthology.orchestra.run.trial157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/98 2026-02-12T10:52:00.080 INFO:teuthology.orchestra.run.trial049.stdout:(22/98): python3-ply-3.11-14.el9.noarch.rpm 4.0 MB/s | 106 kB 00:00 2026-02-12T10:52:00.081 INFO:teuthology.orchestra.run.trial049.stdout:(23/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 130 kB/s | 40 kB 00:00 2026-02-12T10:52:00.089 INFO:teuthology.orchestra.run.trial028.stdout:(88/98): python3-routes-2.5.1-5.el9.noarch.rpm 4.6 MB/s | 188 kB 00:00 2026-02-12T10:52:00.091 INFO:teuthology.orchestra.run.trial028.stdout:(89/98): python3-rsa-4.9-2.el9.noarch.rpm 1.6 MB/s | 59 kB 00:00 2026-02-12T10:52:00.091 INFO:teuthology.orchestra.run.trial028.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 3.5 MB/s | 125 kB 00:00 2026-02-12T10:52:00.095 INFO:teuthology.orchestra.run.trial049.stdout:(24/98): python3-pycparser-2.20-6.el9.noarch.rp 4.1 MB/s | 135 kB 00:00 2026-02-12T10:52:00.106 INFO:teuthology.orchestra.run.trial049.stdout:(25/98): python3-requests-2.25.1-10.el9.noarch. 4.8 MB/s | 126 kB 00:00 2026-02-12T10:52:00.123 INFO:teuthology.orchestra.run.trial028.stdout:(91/98): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-12T10:52:00.127 INFO:teuthology.orchestra.run.trial028.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 2.3 MB/s | 86 kB 00:00 2026-02-12T10:52:00.128 INFO:teuthology.orchestra.run.trial028.stdout:(93/98): python3-webob-1.8.8-2.el9.noarch.rpm 6.1 MB/s | 230 kB 00:00 2026-02-12T10:52:00.129 INFO:teuthology.orchestra.run.trial049.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 5.3 MB/s | 182 kB 00:00 2026-02-12T10:52:00.133 INFO:teuthology.orchestra.run.trial049.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 9.7 MB/s | 266 kB 00:00 2026-02-12T10:52:00.159 INFO:teuthology.orchestra.run.trial028.stdout:(94/98): python3-websocket-client-1.2.3-2.el9.n 2.4 MB/s | 90 kB 00:00 2026-02-12T10:52:00.164 INFO:teuthology.orchestra.run.trial028.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.3 MB/s | 48 kB 00:00 2026-02-12T10:52:00.173 INFO:teuthology.orchestra.run.trial049.stdout:(28/98): python3-urllib3-1.26.5-7.el9.noarch.rp 2.3 MB/s | 218 kB 00:00 2026-02-12T10:52:00.183 INFO:teuthology.orchestra.run.trial028.stdout:(96/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 7.5 MB/s | 427 kB 00:00 2026-02-12T10:52:00.193 INFO:teuthology.orchestra.run.trial028.stdout:(97/98): python3-xmltodict-0.12.0-15.el9.noarch 644 kB/s | 22 kB 00:00 2026-02-12T10:52:00.198 INFO:teuthology.orchestra.run.trial028.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 584 kB/s | 20 kB 00:00 2026-02-12T10:52:00.199 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:00.200 INFO:teuthology.orchestra.run.trial028.stdout:Total 27 MB/s | 95 MB 00:03 2026-02-12T10:52:00.401 INFO:teuthology.orchestra.run.trial157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 67/98 2026-02-12T10:52:00.475 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-12T10:52:00.556 INFO:teuthology.orchestra.run.trial049.stdout:(29/98): flexiblas-3.0.4-8.el9.x86_64.rpm 77 kB/s | 33 kB 00:00 2026-02-12T10:52:00.578 INFO:teuthology.orchestra.run.trial049.stdout:(30/98): flexiblas-openblas-openmp-3.0.4-8.el9. 45 kB/s | 18 kB 00:00 2026-02-12T10:52:00.617 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:00.656 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:00.656 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:00.877 INFO:teuthology.orchestra.run.trial049.stdout:(31/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 768 kB/s | 246 kB 00:00 2026-02-12T10:52:00.902 INFO:teuthology.orchestra.run.trial049.stdout:(32/98): lua-5.4.4-4.el9.x86_64.rpm 582 kB/s | 188 kB 00:00 2026-02-12T10:52:00.974 INFO:teuthology.orchestra.run.trial049.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 435 kB/s | 42 kB 00:00 2026-02-12T10:52:01.075 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:01.075 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:01.153 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-12T10:52:01.171 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-12T10:52:01.185 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-12T10:52:01.201 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-12T10:52:01.277 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-12T10:52:01.286 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-12T10:52:01.309 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-12T10:52:01.339 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-12T10:52:01.391 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-12T10:52:01.397 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-12T10:52:01.401 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-12T10:52:01.402 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-12T10:52:01.420 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:01.420 INFO:teuthology.orchestra.run.trial157.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T10:52:01.420 INFO:teuthology.orchestra.run.trial157.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T10:52:01.420 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:01.427 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:01.453 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:01.453 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T10:52:01.453 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:01.488 INFO:teuthology.orchestra.run.trial157.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-12T10:52:01.527 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:01.529 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-12T10:52:01.552 INFO:teuthology.orchestra.run.trial157.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-12T10:52:01.554 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-12T10:52:01.560 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-12T10:52:01.565 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-12T10:52:01.567 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-12T10:52:01.567 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:01.567 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T10:52:01.567 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:01.586 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-12T10:52:01.597 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-12T10:52:01.603 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-12T10:52:01.636 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-12T10:52:01.646 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-12T10:52:01.651 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-12T10:52:01.653 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-12T10:52:01.658 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 11/98 2026-02-12T10:52:01.681 INFO:teuthology.orchestra.run.trial028.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-12T10:52:01.694 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-12T10:52:01.698 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-12T10:52:01.704 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-12T10:52:01.706 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-12T10:52:01.717 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-12T10:52:01.723 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-12T10:52:01.748 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-12T10:52:01.751 INFO:teuthology.orchestra.run.trial028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-12T10:52:01.758 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-12T10:52:01.782 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-12T10:52:01.834 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-12T10:52:01.847 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-12T10:52:01.849 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-12T10:52:01.854 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-12T10:52:01.859 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-12T10:52:01.864 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-12T10:52:01.867 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-12T10:52:01.882 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-12T10:52:01.903 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-12T10:52:01.907 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-12T10:52:01.912 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-12T10:52:01.924 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-12T10:52:01.933 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-12T10:52:01.940 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-12T10:52:01.959 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-12T10:52:01.968 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-12T10:52:02.023 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-12T10:52:02.035 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-12T10:52:02.051 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-12T10:52:02.055 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-12T10:52:02.063 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-12T10:52:02.103 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-12T10:52:02.121 INFO:teuthology.orchestra.run.trial049.stdout:(34/98): protobuf-3.14.0-17.el9.x86_64.rpm 897 kB/s | 1.0 MB 00:01 2026-02-12T10:52:02.265 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-12T10:52:02.290 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-12T10:52:02.291 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:02.291 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T10:52:02.291 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T10:52:02.291 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T10:52:02.291 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:02.348 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-12T10:52:02.350 INFO:teuthology.orchestra.run.trial157.stdout: Installing : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-12T10:52:02.355 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 87/98 2026-02-12T10:52:02.375 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 88/98 2026-02-12T10:52:02.376 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-12T10:52:02.430 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-12T10:52:02.440 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-12T10:52:02.444 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-12T10:52:02.450 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-12T10:52:02.452 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-12T10:52:02.481 INFO:teuthology.orchestra.run.trial028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-12T10:52:02.525 INFO:teuthology.orchestra.run.trial028.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-12T10:52:02.531 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-12T10:52:02.535 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-12T10:52:02.541 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-12T10:52:02.544 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-12T10:52:02.551 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-12T10:52:02.555 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-12T10:52:02.583 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-12T10:52:02.593 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-12T10:52:02.629 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-12T10:52:02.855 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-12T10:52:02.874 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-12T10:52:02.877 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-12T10:52:02.879 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-12T10:52:02.883 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-12T10:52:02.942 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-12T10:52:02.944 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-12T10:52:02.965 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/98 2026-02-12T10:52:03.292 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 67/98 2026-02-12T10:52:03.333 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-12T10:52:03.334 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-12T10:52:03.348 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-12T10:52:03.348 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-12T10:52:03.366 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-12T10:52:03.406 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-12T10:52:03.455 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 93/98 2026-02-12T10:52:03.456 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-12T10:52:03.478 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-12T10:52:03.478 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:03.478 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T10:52:03.479 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T10:52:03.479 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T10:52:03.479 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:03.490 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-12T10:52:03.710 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-12T10:52:03.712 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-12T10:52:03.735 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-12T10:52:03.735 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:03.736 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T10:52:03.736 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T10:52:03.736 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T10:52:03.736 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:03.807 INFO:teuthology.orchestra.run.trial049.stdout:(35/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 1.8 MB/s | 5.3 MB 00:02 2026-02-12T10:52:03.839 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-12T10:52:03.860 INFO:teuthology.orchestra.run.trial049.stdout:(36/98): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 821 kB/s | 3.0 MB 00:03 2026-02-12T10:52:03.861 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-12T10:52:03.861 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:03.861 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T10:52:03.861 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T10:52:03.861 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T10:52:03.861 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:03.879 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-12T10:52:03.905 INFO:teuthology.orchestra.run.trial049.stdout:(37/98): python3-devel-3.9.25-2.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2026-02-12T10:52:04.003 INFO:teuthology.orchestra.run.trial049.stdout:(38/98): python3-libstoragemgmt-1.10.1-1.el9.x8 1.8 MB/s | 177 kB 00:00 2026-02-12T10:52:04.045 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-12T10:52:04.065 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-12T10:52:04.078 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-12T10:52:04.094 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-12T10:52:04.106 INFO:teuthology.orchestra.run.trial049.stdout:(39/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2026-02-12T10:52:04.170 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-12T10:52:04.179 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-12T10:52:04.182 INFO:teuthology.orchestra.run.trial049.stdout:(40/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 773 kB/s | 249 kB 00:00 2026-02-12T10:52:04.203 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-12T10:52:04.203 INFO:teuthology.orchestra.run.trial049.stdout:(41/98): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2026-02-12T10:52:04.233 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-12T10:52:04.278 INFO:teuthology.orchestra.run.trial049.stdout:(42/98): python3-markupsafe-1.1.1-12.el9.x86_64 361 kB/s | 35 kB 00:00 2026-02-12T10:52:04.284 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-12T10:52:04.290 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-12T10:52:04.293 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-12T10:52:04.295 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-12T10:52:04.314 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:04.314 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T10:52:04.314 INFO:teuthology.orchestra.run.trial028.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T10:52:04.314 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:04.323 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:04.349 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:04.350 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T10:52:04.350 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:04.386 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-12T10:52:04.450 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-12T10:52:04.452 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-12T10:52:04.466 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-12T10:52:04.466 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:04.466 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T10:52:04.467 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 1/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 3/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 4/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 5/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 6/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 7/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 8/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 9/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 10/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 11/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 12/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 13/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 14/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 15/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 29/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 30/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 31/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-12T10:52:04.562 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-12T10:52:04.563 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-12T10:52:04.564 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-12T10:52:04.601 INFO:teuthology.orchestra.run.trial049.stdout:(43/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 1.3 MB/s | 442 kB 00:00 2026-02-12T10:52:04.615 INFO:teuthology.orchestra.run.trial049.stdout:(44/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 15 MB/s | 6.1 MB 00:00 2026-02-12T10:52:04.629 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-12T10:52:04.629 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:04.629 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:04.629 INFO:teuthology.orchestra.run.trial157.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.630 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T10:52:04.631 INFO:teuthology.orchestra.run.trial157.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T10:52:04.632 INFO:teuthology.orchestra.run.trial157.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T10:52:04.633 INFO:teuthology.orchestra.run.trial157.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T10:52:04.634 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-12T10:52:04.635 INFO:teuthology.orchestra.run.trial157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T10:52:04.636 INFO:teuthology.orchestra.run.trial157.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T10:52:04.637 INFO:teuthology.orchestra.run.trial157.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T10:52:04.638 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T10:52:04.639 INFO:teuthology.orchestra.run.trial157.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T10:52:04.639 INFO:teuthology.orchestra.run.trial157.stdout: zip-3.0-35.el9.x86_64 2026-02-12T10:52:04.639 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:04.639 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:04.686 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-base 2026-02-12T10:52:04.698 INFO:teuthology.orchestra.run.trial049.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 797 kB/s | 77 kB 00:00 2026-02-12T10:52:04.713 INFO:teuthology.orchestra.run.trial049.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 2.7 MB/s | 267 kB 00:00 2026-02-12T10:52:04.795 INFO:teuthology.orchestra.run.trial049.stdout:(47/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2026-02-12T10:52:04.811 INFO:teuthology.orchestra.run.trial049.stdout:(48/98): python3-pyasn1-modules-0.4.8-6.el9.noa 2.8 MB/s | 279 kB 00:00 2026-02-12T10:52:04.892 INFO:teuthology.orchestra.run.trial049.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 556 kB/s | 54 kB 00:00 2026-02-12T10:52:04.989 INFO:teuthology.orchestra.run.trial049.stdout:(50/98): python3-toml-0.10.2-6.el9.noarch.rpm 428 kB/s | 42 kB 00:00 2026-02-12T10:52:04.992 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:05.056 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:05.075 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:05.075 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:05.076 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:05.086 INFO:teuthology.orchestra.run.trial049.stdout:(51/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.9 MB/s | 189 kB 00:00 2026-02-12T10:52:05.096 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install cephadm 2026-02-12T10:52:05.165 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-12T10:52:05.182 INFO:teuthology.orchestra.run.trial049.stdout:(52/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 941 kB/s | 90 kB 00:00 2026-02-12T10:52:05.190 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-12T10:52:05.190 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:05.190 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T10:52:05.190 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T10:52:05.190 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T10:52:05.190 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:05.251 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-12T10:52:05.252 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-12T10:52:05.257 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 87/98 2026-02-12T10:52:05.270 INFO:teuthology.orchestra.run.trial049.stdout:(53/98): lua-devel-5.4.4-4.el9.x86_64.rpm 252 kB/s | 22 kB 00:00 2026-02-12T10:52:05.277 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 88/98 2026-02-12T10:52:05.278 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-12T10:52:05.319 INFO:teuthology.orchestra.run.trial049.stdout:(54/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 38 MB/s | 19 MB 00:00 2026-02-12T10:52:05.396 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:30 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:05.429 INFO:teuthology.orchestra.run.trial049.stdout:(55/98): protobuf-compiler-3.14.0-17.el9.x86_64 5.3 MB/s | 862 kB 00:00 2026-02-12T10:52:05.461 INFO:teuthology.orchestra.run.trial157.stdout:Package cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:05.479 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:05.480 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:05.480 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:05.501 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T10:52:05.502 INFO:teuthology.orchestra.run.trial049.stdout:(56/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.0 MB/s | 551 kB 00:00 2026-02-12T10:52:05.511 INFO:teuthology.orchestra.run.trial049.stdout:(57/98): grpc-data-1.46.7-10.el9.noarch.rpm 237 kB/s | 19 kB 00:00 2026-02-12T10:52:05.523 INFO:teuthology.orchestra.run.trial049.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 6.5 MB/s | 151 kB 00:00 2026-02-12T10:52:05.542 INFO:teuthology.orchestra.run.trial049.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 1.5 MB/s | 29 kB 00:00 2026-02-12T10:52:05.563 INFO:teuthology.orchestra.run.trial049.stdout:(60/98): python3-backports-tarfile-1.2.0-1.el9. 2.9 MB/s | 60 kB 00:00 2026-02-12T10:52:05.583 INFO:teuthology.orchestra.run.trial049.stdout:(61/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.2 MB/s | 43 kB 00:00 2026-02-12T10:52:05.602 INFO:teuthology.orchestra.run.trial049.stdout:(62/98): python3-cachetools-4.2.4-1.el9.noarch. 1.6 MB/s | 32 kB 00:00 2026-02-12T10:52:05.615 INFO:teuthology.orchestra.run.trial049.stdout:(63/98): python3-asyncssh-2.13.2-5.el9.noarch.r 5.2 MB/s | 548 kB 00:00 2026-02-12T10:52:05.622 INFO:teuthology.orchestra.run.trial049.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 731 kB/s | 14 kB 00:00 2026-02-12T10:52:05.638 INFO:teuthology.orchestra.run.trial049.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 7.4 MB/s | 173 kB 00:00 2026-02-12T10:52:05.650 INFO:teuthology.orchestra.run.trial049.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2026-02-12T10:52:05.663 INFO:teuthology.orchestra.run.trial049.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 9.9 MB/s | 254 kB 00:00 2026-02-12T10:52:05.686 INFO:teuthology.orchestra.run.trial049.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 6.2 MB/s | 144 kB 00:00 2026-02-12T10:52:05.708 INFO:teuthology.orchestra.run.trial049.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 6.1 MB/s | 139 kB 00:00 2026-02-12T10:52:05.714 INFO:teuthology.orchestra.run.trial049.stdout:(70/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 32 MB/s | 2.0 MB 00:00 2026-02-12T10:52:05.728 INFO:teuthology.orchestra.run.trial049.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 2.8 MB/s | 56 kB 00:00 2026-02-12T10:52:05.733 INFO:teuthology.orchestra.run.trial049.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 555 kB/s | 11 kB 00:00 2026-02-12T10:52:05.748 INFO:teuthology.orchestra.run.trial049.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 895 kB/s | 18 kB 00:00 2026-02-12T10:52:05.753 INFO:teuthology.orchestra.run.trial049.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-12T10:52:05.768 INFO:teuthology.orchestra.run.trial049.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 990 kB/s | 20 kB 00:00 2026-02-12T10:52:05.772 INFO:teuthology.orchestra.run.trial049.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 992 kB/s | 19 kB 00:00 2026-02-12T10:52:05.773 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-12T10:52:05.776 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-12T10:52:05.788 INFO:teuthology.orchestra.run.trial049.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 1.3 MB/s | 26 kB 00:00 2026-02-12T10:52:05.799 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:30 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:05.802 INFO:teuthology.orchestra.run.trial049.stdout:(78/98): python3-kubernetes-26.1.0-3.el9.noarch 34 MB/s | 1.0 MB 00:00 2026-02-12T10:52:05.808 INFO:teuthology.orchestra.run.trial049.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 2.3 MB/s | 46 kB 00:00 2026-02-12T10:52:05.822 INFO:teuthology.orchestra.run.trial049.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 3.8 MB/s | 79 kB 00:00 2026-02-12T10:52:05.830 INFO:teuthology.orchestra.run.trial049.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 4.0 MB/s | 86 kB 00:00 2026-02-12T10:52:05.842 INFO:teuthology.orchestra.run.trial049.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 2.8 MB/s | 58 kB 00:00 2026-02-12T10:52:05.855 INFO:teuthology.orchestra.run.trial049.stdout:(83/98): python3-pecan-1.4.2-3.el9.noarch.rpm 10 MB/s | 272 kB 00:00 2026-02-12T10:52:05.862 INFO:teuthology.orchestra.run.trial049.stdout:(84/98): python3-portend-3.1.0-2.el9.noarch.rpm 843 kB/s | 16 kB 00:00 2026-02-12T10:52:05.877 INFO:teuthology.orchestra.run.trial049.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.2 MB/s | 90 kB 00:00 2026-02-12T10:52:05.882 INFO:teuthology.orchestra.run.trial049.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-12T10:52:05.886 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:05.887 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-680.g05b55d19.el9 ceph 145 k 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:05.888 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-12T10:52:05.889 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:05.889 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 145 k 2026-02-12T10:52:05.889 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 431 k 2026-02-12T10:52:05.889 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:52:05.900 INFO:teuthology.orchestra.run.trial049.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 7.8 MB/s | 188 kB 00:00 2026-02-12T10:52:05.902 INFO:teuthology.orchestra.run.trial049.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 2.9 MB/s | 59 kB 00:00 2026-02-12T10:52:05.921 INFO:teuthology.orchestra.run.trial049.stdout:(89/98): python3-tempora-5.0.0-2.el9.noarch.rpm 1.8 MB/s | 36 kB 00:00 2026-02-12T10:52:05.922 INFO:teuthology.orchestra.run.trial049.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 5.5 MB/s | 125 kB 00:00 2026-02-12T10:52:05.941 INFO:teuthology.orchestra.run.trial049.stdout:(91/98): python3-typing-extensions-4.15.0-1.el9 4.2 MB/s | 86 kB 00:00 2026-02-12T10:52:05.947 INFO:teuthology.orchestra.run.trial049.stdout:(92/98): python3-webob-1.8.8-2.el9.noarch.rpm 9.3 MB/s | 230 kB 00:00 2026-02-12T10:52:05.962 INFO:teuthology.orchestra.run.trial049.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 4.4 MB/s | 90 kB 00:00 2026-02-12T10:52:05.976 INFO:teuthology.orchestra.run.trial049.stdout:(94/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 14 MB/s | 427 kB 00:00 2026-02-12T10:52:05.982 INFO:teuthology.orchestra.run.trial049.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.4 MB/s | 48 kB 00:00 2026-02-12T10:52:05.996 INFO:teuthology.orchestra.run.trial049.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 1.1 MB/s | 22 kB 00:00 2026-02-12T10:52:06.002 INFO:teuthology.orchestra.run.trial049.stdout:(97/98): python3-zc-lockfile-2.0-10.el9.noarch. 998 kB/s | 20 kB 00:00 2026-02-12T10:52:06.230 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-12T10:52:06.231 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-12T10:52:06.243 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-12T10:52:06.243 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-12T10:52:06.252 INFO:teuthology.orchestra.run.trial157.stdout:ceph-immutable-object-cache-19.2.3-680.g05b55d1 398 kB/s | 145 kB 00:00 2026-02-12T10:52:06.253 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:06.253 INFO:teuthology.orchestra.run.trial157.stdout:Total 397 kB/s | 145 kB 00:00 2026-02-12T10:52:06.253 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:52:06.257 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:52:06.258 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:52:06.290 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:52:06.290 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:52:06.300 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-12T10:52:06.345 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:52:06.346 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:06.349 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 93/98 2026-02-12T10:52:06.350 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-12T10:52:06.368 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:06.368 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:06.368 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T10:52:06.368 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:06.373 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-12T10:52:06.373 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:06.373 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T10:52:06.373 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T10:52:06.373 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T10:52:06.373 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:06.385 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-12T10:52:06.600 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-12T10:52:06.602 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-12T10:52:06.623 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-12T10:52:06.623 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:06.623 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T10:52:06.623 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T10:52:06.623 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T10:52:06.623 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:06.673 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:06.673 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:06.673 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:06.673 INFO:teuthology.orchestra.run.trial157.stdout: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:06.673 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:06.673 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:06.700 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr 2026-02-12T10:52:06.725 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-12T10:52:06.745 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-12T10:52:06.745 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:06.745 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T10:52:06.745 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T10:52:06.745 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T10:52:06.745 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:06.764 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-12T10:52:07.008 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:32 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:07.075 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:07.093 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:07.094 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:07.094 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:07.116 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T10:52:07.416 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:32 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:07.446 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-12T10:52:07.446 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 1/98 2026-02-12T10:52:07.446 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2/98 2026-02-12T10:52:07.446 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 3/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 4/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 5/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 6/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 7/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 8/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 9/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 10/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 11/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 12/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 13/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 14/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 15/98 2026-02-12T10:52:07.447 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-12T10:52:07.448 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 29/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 30/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 31/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-12T10:52:07.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-12T10:52:07.450 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-12T10:52:07.451 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-12T10:52:07.452 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-12T10:52:07.453 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-12T10:52:07.454 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-12T10:52:07.454 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-12T10:52:07.454 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-12T10:52:07.454 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-12T10:52:07.481 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:07.499 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:07.500 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:07.500 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:07.510 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-12T10:52:07.510 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:07.510 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:07.510 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T10:52:07.510 INFO:teuthology.orchestra.run.trial028.stdout: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:07.510 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.510 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T10:52:07.512 INFO:teuthology.orchestra.run.trial028.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T10:52:07.513 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T10:52:07.514 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T10:52:07.515 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-12T10:52:07.516 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T10:52:07.517 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T10:52:07.518 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: zip-3.0-35.el9.x86_64 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:07.519 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:07.521 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T10:52:07.568 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-base 2026-02-12T10:52:07.816 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:32 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:07.879 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:30 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:07.881 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:07.900 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:07.901 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:07.901 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:07.922 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-rook 2026-02-12T10:52:07.923 INFO:teuthology.orchestra.run.trial049.stdout:(98/98): python3-babel-2.9.1-2.el9.noarch.rpm 1.0 MB/s | 6.0 MB 00:05 2026-02-12T10:52:07.925 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:07.926 INFO:teuthology.orchestra.run.trial049.stdout:Total 9.1 MB/s | 95 MB 00:10 2026-02-12T10:52:07.943 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:07.962 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:07.963 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:07.963 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:07.984 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install cephadm 2026-02-12T10:52:08.225 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:33 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:08.282 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:31 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:08.291 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:08.309 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:08.310 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:08.310 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:08.332 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T10:52:08.335 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:08.346 INFO:teuthology.orchestra.run.trial028.stdout:Package cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:08.364 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:08.365 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:08.365 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:08.374 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:08.374 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:08.387 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T10:52:08.636 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:33 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:08.684 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:31 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:08.700 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:08.719 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:08.719 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:08.719 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:08.740 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-fuse 2026-02-12T10:52:08.768 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-680.g05b55d19.el9 ceph 145 k 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:08.769 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-12T10:52:08.770 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:08.770 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 145 k 2026-02-12T10:52:08.770 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 431 k 2026-02-12T10:52:08.770 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:52:08.790 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:08.790 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:09.040 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:34 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:09.061 INFO:teuthology.orchestra.run.trial028.stdout:ceph-immutable-object-cache-19.2.3-680.g05b55d1 498 kB/s | 145 kB 00:00 2026-02-12T10:52:09.061 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:09.062 INFO:teuthology.orchestra.run.trial028.stdout:Total 496 kB/s | 145 kB 00:00 2026-02-12T10:52:09.062 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:09.065 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:09.065 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:09.097 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:09.098 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:09.123 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout: ceph-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.2 M 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:52:09.124 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:09.125 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-12T10:52:09.125 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:09.125 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 1.2 M 2026-02-12T10:52:09.125 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 3.6 M 2026-02-12T10:52:09.125 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:52:09.152 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:09.153 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:09.175 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:09.175 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:09.175 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T10:52:09.175 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:09.241 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:09.243 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-12T10:52:09.274 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-12T10:52:09.278 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-12T10:52:09.299 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-12T10:52:09.310 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-12T10:52:09.315 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-12T10:52:09.348 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-12T10:52:09.357 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-12T10:52:09.362 INFO:teuthology.orchestra.run.trial049.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-12T10:52:09.364 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-12T10:52:09.368 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 11/98 2026-02-12T10:52:09.391 INFO:teuthology.orchestra.run.trial049.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-12T10:52:09.403 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-12T10:52:09.407 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-12T10:52:09.413 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-12T10:52:09.414 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-12T10:52:09.425 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-12T10:52:09.431 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-12T10:52:09.449 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:09.449 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:09.449 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:09.449 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:09.449 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:09.450 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:09.455 INFO:teuthology.orchestra.run.trial049.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-12T10:52:09.458 INFO:teuthology.orchestra.run.trial049.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-12T10:52:09.465 INFO:teuthology.orchestra.run.trial049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-12T10:52:09.476 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr 2026-02-12T10:52:09.489 INFO:teuthology.orchestra.run.trial049.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-12T10:52:09.539 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-12T10:52:09.552 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-12T10:52:09.554 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-12T10:52:09.559 INFO:teuthology.orchestra.run.trial049.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-12T10:52:09.564 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-12T10:52:09.569 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-12T10:52:09.572 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-12T10:52:09.586 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-12T10:52:09.607 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-12T10:52:09.611 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-12T10:52:09.616 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-12T10:52:09.627 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-12T10:52:09.636 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-12T10:52:09.643 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-12T10:52:09.662 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-12T10:52:09.671 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-12T10:52:09.724 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-12T10:52:09.736 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-12T10:52:09.752 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-12T10:52:09.756 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-12T10:52:09.764 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-12T10:52:09.777 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:32 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:09.803 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-12T10:52:09.842 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:09.861 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:09.861 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:09.861 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:09.882 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T10:52:10.124 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-12T10:52:10.134 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-12T10:52:10.138 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-12T10:52:10.143 INFO:teuthology.orchestra.run.trial157.stdout:ceph-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 1.1 MB/s | 1.2 MB 00:01 2026-02-12T10:52:10.144 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-12T10:52:10.145 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:10.145 INFO:teuthology.orchestra.run.trial157.stdout:Total 1.1 MB/s | 1.2 MB 00:01 2026-02-12T10:52:10.145 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:52:10.146 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-12T10:52:10.149 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:52:10.149 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:52:10.172 INFO:teuthology.orchestra.run.trial049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-12T10:52:10.182 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:33 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:10.183 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:52:10.184 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:52:10.216 INFO:teuthology.orchestra.run.trial049.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-12T10:52:10.223 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-12T10:52:10.226 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-12T10:52:10.232 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-12T10:52:10.236 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-12T10:52:10.243 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-12T10:52:10.246 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-12T10:52:10.248 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:10.267 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:10.268 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:10.268 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:10.274 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-12T10:52:10.283 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-12T10:52:10.285 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:52:10.289 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T10:52:10.302 INFO:teuthology.orchestra.run.trial157.stdout: Installing : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:10.318 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-12T10:52:10.540 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-12T10:52:10.544 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:10.563 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-12T10:52:10.567 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-12T10:52:10.588 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:33 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:10.601 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:10.601 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:10.601 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:10.601 INFO:teuthology.orchestra.run.trial157.stdout: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:10.601 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:10.601 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:10.625 INFO:teuthology.orchestra.run.trial049.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-12T10:52:10.626 INFO:teuthology.orchestra.run.trial049.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-12T10:52:10.629 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install ceph-volume 2026-02-12T10:52:10.647 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 66/98 2026-02-12T10:52:10.652 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:10.671 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:10.672 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:10.672 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:10.694 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-rook 2026-02-12T10:52:10.933 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:35 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:10.969 INFO:teuthology.orchestra.run.trial049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 67/98 2026-02-12T10:52:10.996 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:33 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:10.999 INFO:teuthology.orchestra.run.trial157.stdout:Package ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:11.018 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:11.019 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:11.019 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:11.040 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librados-devel 2026-02-12T10:52:11.041 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-12T10:52:11.061 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:11.080 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:11.081 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:11.081 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:11.102 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T10:52:11.341 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:36 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:11.405 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:34 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:11.425 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:11.426 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:11.426 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-12T10:52:11.426 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:11.426 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:52:11.426 INFO:teuthology.orchestra.run.trial157.stdout: librados-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 126 k 2026-02-12T10:52:11.426 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:11.426 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:52:11.427 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:11.427 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-12T10:52:11.427 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:11.427 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 126 k 2026-02-12T10:52:11.427 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 456 k 2026-02-12T10:52:11.427 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:52:11.470 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:11.489 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:11.490 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:11.490 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:11.512 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-fuse 2026-02-12T10:52:11.706 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-12T10:52:11.726 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-12T10:52:11.739 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-12T10:52:11.755 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-12T10:52:11.810 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:34 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:11.830 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-12T10:52:11.838 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-12T10:52:11.847 INFO:teuthology.orchestra.run.trial157.stdout:librados-devel-19.2.3-680.g05b55d19.el9.x86_64. 300 kB/s | 126 kB 00:00 2026-02-12T10:52:11.848 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:11.849 INFO:teuthology.orchestra.run.trial157.stdout:Total 299 kB/s | 126 kB 00:00 2026-02-12T10:52:11.849 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:52:11.851 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:52:11.851 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:52:11.865 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-12T10:52:11.882 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:52:11.882 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:52:11.893 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:11.893 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:11.893 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:11.893 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.2 M 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 1.2 M 2026-02-12T10:52:11.894 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 3.6 M 2026-02-12T10:52:11.895 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:52:11.895 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-12T10:52:11.937 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:52:11.946 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-12T10:52:11.952 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-12T10:52:11.954 INFO:teuthology.orchestra.run.trial157.stdout: Installing : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:11.956 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-12T10:52:11.957 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-12T10:52:11.976 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:11.976 INFO:teuthology.orchestra.run.trial049.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T10:52:11.976 INFO:teuthology.orchestra.run.trial049.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T10:52:11.976 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:11.985 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:12.012 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-12T10:52:12.012 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T10:52:12.012 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:12.035 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:12.048 INFO:teuthology.orchestra.run.trial049.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-12T10:52:12.091 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:12.091 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:12.092 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:12.092 INFO:teuthology.orchestra.run.trial157.stdout: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:12.092 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:12.092 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:12.110 INFO:teuthology.orchestra.run.trial049.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-12T10:52:12.113 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-12T10:52:12.120 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install libcephfs2 2026-02-12T10:52:12.127 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 84/98 2026-02-12T10:52:12.127 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:12.127 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T10:52:12.127 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:12.427 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:37 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:12.458 INFO:teuthology.orchestra.run.trial028.stdout:ceph-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 2.0 MB/s | 1.2 MB 00:00 2026-02-12T10:52:12.459 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:12.459 INFO:teuthology.orchestra.run.trial028.stdout:Total 2.0 MB/s | 1.2 MB 00:00 2026-02-12T10:52:12.459 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:12.462 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:12.463 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:12.493 INFO:teuthology.orchestra.run.trial157.stdout:Package libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:12.497 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:12.497 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:12.512 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:12.512 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:12.512 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:12.534 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install libcephfs-devel 2026-02-12T10:52:12.599 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:12.616 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:12.825 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-12T10:52:12.835 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:37 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:12.850 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 85/98 2026-02-12T10:52:12.850 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:12.850 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T10:52:12.850 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T10:52:12.850 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T10:52:12.850 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:12.874 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:12.908 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-12T10:52:12.910 INFO:teuthology.orchestra.run.trial049.stdout: Installing : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 86/98 2026-02-12T10:52:12.915 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 87/98 2026-02-12T10:52:12.918 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:12.920 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:12.920 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-12T10:52:12.920 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:12.920 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:52:12.920 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 34 k 2026-02-12T10:52:12.920 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:12.920 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:52:12.921 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:12.921 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-12T10:52:12.921 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:12.921 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 34 k 2026-02-12T10:52:12.921 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 153 k 2026-02-12T10:52:12.921 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:52:12.931 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:12.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:12.932 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:12.932 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:12.932 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:12.932 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:12.934 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 88/98 2026-02-12T10:52:12.936 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-12T10:52:12.960 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-volume 2026-02-12T10:52:13.122 INFO:teuthology.orchestra.run.trial157.stdout:libcephfs-devel-19.2.3-680.g05b55d19.el9.x86_64 166 kB/s | 34 kB 00:00 2026-02-12T10:52:13.123 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:13.124 INFO:teuthology.orchestra.run.trial157.stdout:Total 165 kB/s | 34 kB 00:00 2026-02-12T10:52:13.124 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:52:13.125 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:52:13.126 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:52:13.128 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:52:13.128 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:52:13.148 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:52:13.164 INFO:teuthology.orchestra.run.trial157.stdout: Installing : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:13.219 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:13.257 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:36 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:13.276 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:13.276 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:13.276 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:13.277 INFO:teuthology.orchestra.run.trial157.stdout: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:13.277 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:13.277 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:13.306 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librados2 2026-02-12T10:52:13.322 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:13.340 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:13.341 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:13.341 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:13.362 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librados-devel 2026-02-12T10:52:13.427 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 89/98 2026-02-12T10:52:13.430 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-12T10:52:13.607 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:13.660 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:36 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:13.671 INFO:teuthology.orchestra.run.trial157.stdout:Package librados2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:13.690 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:13.690 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:13.690 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:13.712 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install librbd1 2026-02-12T10:52:13.745 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:13.745 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:13.745 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-12T10:52:13.745 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 126 k 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 126 k 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 456 k 2026-02-12T10:52:13.746 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:52:13.885 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 90/98 2026-02-12T10:52:13.886 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-12T10:52:13.899 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 91/98 2026-02-12T10:52:13.900 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-12T10:52:13.956 INFO:teuthology.orchestra.run.trial028.stdout:librados-devel-19.2.3-680.g05b55d19.el9.x86_64. 601 kB/s | 126 kB 00:00 2026-02-12T10:52:13.956 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:13.956 INFO:teuthology.orchestra.run.trial028.stdout:Total 597 kB/s | 126 kB 00:00 2026-02-12T10:52:13.956 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:13.957 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 92/98 2026-02-12T10:52:13.959 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:13.959 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:13.992 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:13.992 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:14.007 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 93/98 2026-02-12T10:52:14.008 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-12T10:52:14.015 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:14.030 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 94/98 2026-02-12T10:52:14.030 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:14.030 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T10:52:14.030 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T10:52:14.030 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T10:52:14.030 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:14.042 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-12T10:52:14.046 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:14.063 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:14.079 INFO:teuthology.orchestra.run.trial157.stdout:Package librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:14.098 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:14.099 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:14.099 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:14.121 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rados 2026-02-12T10:52:14.140 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:14.198 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:14.198 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:14.198 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:14.198 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:14.198 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:14.198 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:14.227 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install libcephfs2 2026-02-12T10:52:14.255 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 95/98 2026-02-12T10:52:14.256 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-12T10:52:14.277 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 96/98 2026-02-12T10:52:14.277 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:14.277 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T10:52:14.277 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T10:52:14.277 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T10:52:14.277 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:14.377 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-12T10:52:14.398 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 97/98 2026-02-12T10:52:14.398 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:14.398 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T10:52:14.398 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T10:52:14.398 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T10:52:14.398 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:14.416 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-12T10:52:14.424 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:14.489 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:14.507 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:14.508 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:14.508 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:14.529 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rgw 2026-02-12T10:52:14.538 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:37 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:14.603 INFO:teuthology.orchestra.run.trial028.stdout:Package libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:14.622 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:14.622 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:14.622 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:14.644 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install libcephfs-devel 2026-02-12T10:52:14.826 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:14.890 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:14.909 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:14.909 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:14.909 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:14.929 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-cephfs 2026-02-12T10:52:14.948 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:37 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:15.031 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 34 k 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 34 k 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 153 k 2026-02-12T10:52:15.032 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:52:15.084 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 98/98 2026-02-12T10:52:15.084 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-2:19.2.3-680.g05b55d19.el9.x86_64 1/98 2026-02-12T10:52:15.084 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2/98 2026-02-12T10:52:15.084 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 3/98 2026-02-12T10:52:15.084 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 4/98 2026-02-12T10:52:15.084 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 5/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9 6/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 7/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noar 8/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d 9/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noar 10/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.n 11/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 12/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9. 13/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 14/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : cephadm-2:19.2.3-680.g05b55d19.el9.noarch 15/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-12T10:52:15.085 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 29/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 30/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 31/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-12T10:52:15.086 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-12T10:52:15.087 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-12T10:52:15.088 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-grafana-dashboards-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mds-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-k8sevents-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-modules-core-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-mon-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-osd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-prometheus-alerts-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: cephadm-2:19.2.3-680.g05b55d19.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T10:52:15.152 INFO:teuthology.orchestra.run.trial049.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T10:52:15.153 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T10:52:15.154 INFO:teuthology.orchestra.run.trial049.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: zip-3.0-35.el9.x86_64 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:15.155 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:15.183 INFO:teuthology.orchestra.run.trial028.stdout:libcephfs-devel-19.2.3-680.g05b55d19.el9.x86_64 222 kB/s | 34 kB 00:00 2026-02-12T10:52:15.185 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:15.185 INFO:teuthology.orchestra.run.trial028.stdout:Total 219 kB/s | 34 kB 00:00 2026-02-12T10:52:15.185 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:15.188 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:15.188 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:15.190 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:15.190 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:15.207 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-base 2026-02-12T10:52:15.211 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:15.228 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:15.230 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:15.283 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:15.295 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:15.314 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:15.314 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:15.314 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:15.336 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install python3-rbd 2026-02-12T10:52:15.339 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:15.340 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:15.340 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:15.340 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:15.340 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:15.340 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:15.367 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librados2 2026-02-12T10:52:15.511 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:35 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:15.577 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-base-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:15.596 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:15.596 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:15.596 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:15.618 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install cephadm 2026-02-12T10:52:15.638 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:15.672 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:15.703 INFO:teuthology.orchestra.run.trial157.stdout:Package python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:15.721 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:15.722 INFO:teuthology.orchestra.run.trial157.stdout:Nothing to do. 2026-02-12T10:52:15.722 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:15.736 INFO:teuthology.orchestra.run.trial028.stdout:Package librados2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:15.742 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-fuse 2026-02-12T10:52:15.755 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:15.755 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:15.756 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:15.778 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librbd1 2026-02-12T10:52:15.919 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:35 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:15.984 INFO:teuthology.orchestra.run.trial049.stdout:Package cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:16.003 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:16.003 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:16.003 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:16.024 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T10:52:16.038 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:16.074 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout: rbd-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 85 k 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:16.121 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:52:16.122 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:16.122 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-12T10:52:16.122 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:16.122 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 85 k 2026-02-12T10:52:16.122 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 227 k 2026-02-12T10:52:16.122 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:52:16.138 INFO:teuthology.orchestra.run.trial028.stdout:Package librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:16.157 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:16.157 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:16.157 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:16.178 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rados 2026-02-12T10:52:16.320 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:36 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:16.326 INFO:teuthology.orchestra.run.trial157.stdout:rbd-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 417 kB/s | 85 kB 00:00 2026-02-12T10:52:16.326 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:16.326 INFO:teuthology.orchestra.run.trial157.stdout:Total 415 kB/s | 85 kB 00:00 2026-02-12T10:52:16.326 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:52:16.330 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:52:16.330 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:52:16.365 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:52:16.365 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:52:16.404 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:16.404 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:16.404 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-680.g05b55d19.el9 ceph 145 k 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 145 k 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 431 k 2026-02-12T10:52:16.405 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:52:16.418 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:52:16.435 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:16.476 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:16.510 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:16.542 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:16.560 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:16.561 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:16.561 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:16.567 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:16.567 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:16.567 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:16.567 INFO:teuthology.orchestra.run.trial157.stdout: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:16.567 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:16.568 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:16.582 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rgw 2026-02-12T10:52:16.593 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-mirror 2026-02-12T10:52:16.614 INFO:teuthology.orchestra.run.trial049.stdout:ceph-immutable-object-cache-19.2.3-680.g05b55d1 695 kB/s | 145 kB 00:00 2026-02-12T10:52:16.615 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:16.615 INFO:teuthology.orchestra.run.trial049.stdout:Total 691 kB/s | 145 kB 00:00 2026-02-12T10:52:16.615 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:16.620 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:16.620 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:16.653 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:16.653 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:16.708 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:16.710 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:16.733 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:16.733 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:16.734 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T10:52:16.734 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:16.884 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:16.896 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:16.949 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:16.968 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:16.968 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:16.968 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:16.978 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:16.978 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:16.978 INFO:teuthology.orchestra.run.trial157.stdout: Package Arch Version Repo Size 2026-02-12T10:52:16.978 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:16.978 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:52:16.978 INFO:teuthology.orchestra.run.trial157.stdout: rbd-mirror x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.1 M 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 3.1 M 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 13 M 2026-02-12T10:52:16.979 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:52:16.990 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-cephfs 2026-02-12T10:52:17.034 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.e 1/1 2026-02-12T10:52:17.035 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:17.035 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:17.035 INFO:teuthology.orchestra.run.trial049.stdout: ceph-immutable-object-cache-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:17.035 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:17.035 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:17.062 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr 2026-02-12T10:52:17.291 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:17.356 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:17.367 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:37 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:17.374 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:17.375 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:17.375 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:17.397 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rbd 2026-02-12T10:52:17.432 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:17.450 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:17.451 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:17.451 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:17.473 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T10:52:17.702 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:17.707 INFO:teuthology.orchestra.run.trial157.stdout:rbd-mirror-19.2.3-680.g05b55d19.el9.x86_64.rpm 4.3 MB/s | 3.1 MB 00:00 2026-02-12T10:52:17.708 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:17.708 INFO:teuthology.orchestra.run.trial157.stdout:Total 4.3 MB/s | 3.1 MB 00:00 2026-02-12T10:52:17.708 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:52:17.712 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:52:17.712 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:52:17.753 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:52:17.753 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:52:17.767 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:17.772 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:37 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:17.785 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:17.786 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-12T10:52:17.786 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:17.808 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-fuse 2026-02-12T10:52:17.838 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-dashboard-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:17.856 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:17.857 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:17.857 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:17.878 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T10:52:17.944 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:52:17.945 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:17.968 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:17.968 INFO:teuthology.orchestra.run.trial157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:17.968 INFO:teuthology.orchestra.run.trial157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T10:52:17.968 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T10:52:17.968 INFO:teuthology.orchestra.run.trial157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T10:52:17.968 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:18.110 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:18.176 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:18.194 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 85 k 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-12T10:52:18.195 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:18.196 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 85 k 2026-02-12T10:52:18.196 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 227 k 2026-02-12T10:52:18.196 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:52:18.241 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:18.260 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:18.261 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:18.261 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:18.281 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-rook 2026-02-12T10:52:18.286 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:18.286 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:18.286 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:18.286 INFO:teuthology.orchestra.run.trial157.stdout: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:18.286 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:18.286 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:18.314 DEBUG:teuthology.orchestra.run.trial157:> sudo yum -y install rbd-nbd 2026-02-12T10:52:18.452 INFO:teuthology.orchestra.run.trial028.stdout:rbd-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 330 kB/s | 85 kB 00:00 2026-02-12T10:52:18.452 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:18.453 INFO:teuthology.orchestra.run.trial028.stdout:Total 329 kB/s | 85 kB 00:00 2026-02-12T10:52:18.453 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:18.457 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:18.457 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:18.491 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:18.491 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:18.546 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:18.562 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:18.584 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:18.618 INFO:teuthology.orchestra.run.trial157.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 10:51:35 AM UTC. 2026-02-12T10:52:18.640 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:18.650 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-rook-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:18.668 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:18.669 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:18.669 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:18.690 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T10:52:18.698 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:18.698 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:18.698 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:18.698 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:18.699 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:18.699 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:18.699 INFO:teuthology.orchestra.run.trial157.stdout:Dependencies resolved. 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:Installing: 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout: rbd-nbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 170 k 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:Transaction Summary 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:================================================================================ 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:Install 1 Package 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:Total download size: 170 k 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:Installed size: 490 k 2026-02-12T10:52:18.700 INFO:teuthology.orchestra.run.trial157.stdout:Downloading Packages: 2026-02-12T10:52:18.726 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-mirror 2026-02-12T10:52:18.993 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:19.029 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:19.058 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-mgr-cephadm-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:19.077 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:19.078 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:19.078 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:19.099 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-fuse 2026-02-12T10:52:19.111 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.1 M 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-12T10:52:19.112 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:19.113 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 3.1 M 2026-02-12T10:52:19.113 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 13 M 2026-02-12T10:52:19.113 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:52:19.131 INFO:teuthology.orchestra.run.trial157.stdout:rbd-nbd-19.2.3-680.g05b55d19.el9.x86_64.rpm 396 kB/s | 170 kB 00:00 2026-02-12T10:52:19.132 INFO:teuthology.orchestra.run.trial157.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:19.132 INFO:teuthology.orchestra.run.trial157.stdout:Total 395 kB/s | 170 kB 00:00 2026-02-12T10:52:19.132 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction check 2026-02-12T10:52:19.136 INFO:teuthology.orchestra.run.trial157.stdout:Transaction check succeeded. 2026-02-12T10:52:19.136 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction test 2026-02-12T10:52:19.168 INFO:teuthology.orchestra.run.trial157.stdout:Transaction test succeeded. 2026-02-12T10:52:19.168 INFO:teuthology.orchestra.run.trial157.stdout:Running transaction 2026-02-12T10:52:19.224 INFO:teuthology.orchestra.run.trial157.stdout: Preparing : 1/1 2026-02-12T10:52:19.241 INFO:teuthology.orchestra.run.trial157.stdout: Installing : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:19.323 INFO:teuthology.orchestra.run.trial157.stdout: Running scriptlet: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:19.380 INFO:teuthology.orchestra.run.trial157.stdout: Verifying : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:19.381 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:19.381 INFO:teuthology.orchestra.run.trial157.stdout:Installed: 2026-02-12T10:52:19.381 INFO:teuthology.orchestra.run.trial157.stdout: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:19.381 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:52:19.381 INFO:teuthology.orchestra.run.trial157.stdout:Complete! 2026-02-12T10:52:19.396 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:19.409 DEBUG:teuthology.parallel:result is None 2026-02-12T10:52:19.479 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 1.2 M 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T10:52:19.480 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:19.481 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 1.2 M 2026-02-12T10:52:19.481 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 3.6 M 2026-02-12T10:52:19.481 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:52:20.009 INFO:teuthology.orchestra.run.trial049.stdout:ceph-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 2.2 MB/s | 1.2 MB 00:00 2026-02-12T10:52:20.009 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:20.009 INFO:teuthology.orchestra.run.trial049.stdout:Total 2.2 MB/s | 1.2 MB 00:00 2026-02-12T10:52:20.009 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:20.013 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:20.014 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:20.049 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:20.049 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:20.149 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:20.166 INFO:teuthology.orchestra.run.trial049.stdout: Installing : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:20.370 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:20.427 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:20.427 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:20.427 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:20.427 INFO:teuthology.orchestra.run.trial049.stdout: ceph-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:20.428 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:20.428 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:20.454 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install ceph-volume 2026-02-12T10:52:20.520 INFO:teuthology.orchestra.run.trial028.stdout:rbd-mirror-19.2.3-680.g05b55d19.el9.x86_64.rpm 2.2 MB/s | 3.1 MB 00:01 2026-02-12T10:52:20.521 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:20.521 INFO:teuthology.orchestra.run.trial028.stdout:Total 2.2 MB/s | 3.1 MB 00:01 2026-02-12T10:52:20.522 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:20.526 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:20.526 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:20.567 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:20.568 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:20.755 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:20.758 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:20.760 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:20.783 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:20.783 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:20.784 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T10:52:20.784 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T10:52:20.784 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T10:52:20.784 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:20.822 INFO:teuthology.orchestra.run.trial049.stdout:Package ceph-volume-2:19.2.3-680.g05b55d19.el9.noarch is already installed. 2026-02-12T10:52:20.840 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:20.841 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:20.841 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:20.862 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados-devel 2026-02-12T10:52:21.104 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:21.104 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:21.104 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:21.104 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:21.104 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:21.104 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:21.131 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-nbd 2026-02-12T10:52:21.163 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:21.247 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:21.248 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:21.248 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T10:52:21.248 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:21.248 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:52:21.248 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 126 k 2026-02-12T10:52:21.248 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:21.248 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:52:21.249 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:21.249 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T10:52:21.249 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:21.249 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 126 k 2026-02-12T10:52:21.249 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 456 k 2026-02-12T10:52:21.249 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:52:21.426 INFO:teuthology.orchestra.run.trial049.stdout:librados-devel-19.2.3-680.g05b55d19.el9.x86_64. 712 kB/s | 126 kB 00:00 2026-02-12T10:52:21.428 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:21.428 INFO:teuthology.orchestra.run.trial049.stdout:Total 702 kB/s | 126 kB 00:00 2026-02-12T10:52:21.428 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:21.431 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:21.431 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:21.436 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 10:51:37 AM UTC. 2026-02-12T10:52:21.463 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:21.463 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:21.518 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-12T10:52:21.518 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:21.519 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:21.519 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:21.519 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:21.519 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-12T10:52:21.519 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 170 k 2026-02-12T10:52:21.519 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:21.520 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-12T10:52:21.520 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-12T10:52:21.520 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-12T10:52:21.520 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:21.520 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 170 k 2026-02-12T10:52:21.520 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 490 k 2026-02-12T10:52:21.520 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-12T10:52:21.535 INFO:teuthology.orchestra.run.trial049.stdout: Installing : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:21.615 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:21.672 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:21.673 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:21.673 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:21.673 INFO:teuthology.orchestra.run.trial049.stdout: librados-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:21.673 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:21.673 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:21.689 INFO:teuthology.orchestra.run.trial028.stdout:rbd-nbd-19.2.3-680.g05b55d19.el9.x86_64.rpm 999 kB/s | 170 kB 00:00 2026-02-12T10:52:21.690 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:21.690 INFO:teuthology.orchestra.run.trial028.stdout:Total 993 kB/s | 170 kB 00:00 2026-02-12T10:52:21.690 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-12T10:52:21.694 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-12T10:52:21.694 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-12T10:52:21.700 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs2 2026-02-12T10:52:21.727 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-12T10:52:21.727 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-12T10:52:21.783 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-12T10:52:21.800 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:21.879 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:21.936 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:21.936 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:21.936 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-12T10:52:21.936 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:21.937 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:21.937 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-12T10:52:21.969 DEBUG:teuthology.parallel:result is None 2026-02-12T10:52:22.005 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:22.070 INFO:teuthology.orchestra.run.trial049.stdout:Package libcephfs2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:22.090 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:22.091 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:22.091 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:22.111 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install libcephfs-devel 2026-02-12T10:52:22.414 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:22.498 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:22.499 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:22.499 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T10:52:22.499 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:22.499 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:52:22.499 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-devel x86_64 2:19.2.3-680.g05b55d19.el9 ceph 34 k 2026-02-12T10:52:22.499 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:22.500 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:52:22.500 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:22.500 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T10:52:22.500 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:22.500 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 34 k 2026-02-12T10:52:22.500 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 153 k 2026-02-12T10:52:22.500 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:52:22.623 INFO:teuthology.orchestra.run.trial049.stdout:libcephfs-devel-19.2.3-680.g05b55d19.el9.x86_64 271 kB/s | 34 kB 00:00 2026-02-12T10:52:22.623 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:22.624 INFO:teuthology.orchestra.run.trial049.stdout:Total 268 kB/s | 34 kB 00:00 2026-02-12T10:52:22.624 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:22.626 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:22.626 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:22.628 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:22.628 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:22.649 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:22.665 INFO:teuthology.orchestra.run.trial049.stdout: Installing : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:22.725 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:22.783 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:22.783 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:22.783 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:22.783 INFO:teuthology.orchestra.run.trial049.stdout: libcephfs-devel-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:22.784 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:22.784 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:22.812 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librados2 2026-02-12T10:52:23.111 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:23.176 INFO:teuthology.orchestra.run.trial049.stdout:Package librados2-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:23.194 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:23.195 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:23.195 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:23.216 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install librbd1 2026-02-12T10:52:23.517 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:23.582 INFO:teuthology.orchestra.run.trial049.stdout:Package librbd1-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:23.601 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:23.601 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:23.602 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:23.623 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rados 2026-02-12T10:52:23.925 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:23.992 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rados-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:24.010 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:24.011 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:24.011 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:24.032 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rgw 2026-02-12T10:52:24.331 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:24.398 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rgw-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:24.417 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:24.417 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:24.417 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:24.438 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-cephfs 2026-02-12T10:52:24.744 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:24.811 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-cephfs-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:24.830 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:24.830 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:24.830 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:24.852 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install python3-rbd 2026-02-12T10:52:25.163 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:25.231 INFO:teuthology.orchestra.run.trial049.stdout:Package python3-rbd-2:19.2.3-680.g05b55d19.el9.x86_64 is already installed. 2026-02-12T10:52:25.249 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:25.249 INFO:teuthology.orchestra.run.trial049.stdout:Nothing to do. 2026-02-12T10:52:25.249 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:25.273 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-fuse 2026-02-12T10:52:25.577 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:25.661 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse x86_64 2:19.2.3-680.g05b55d19.el9 ceph 85 k 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T10:52:25.662 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:25.663 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 85 k 2026-02-12T10:52:25.663 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 227 k 2026-02-12T10:52:25.663 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:52:26.039 INFO:teuthology.orchestra.run.trial049.stdout:rbd-fuse-19.2.3-680.g05b55d19.el9.x86_64.rpm 225 kB/s | 85 kB 00:00 2026-02-12T10:52:26.039 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:26.039 INFO:teuthology.orchestra.run.trial049.stdout:Total 225 kB/s | 85 kB 00:00 2026-02-12T10:52:26.039 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:26.043 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:26.043 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:26.078 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:26.078 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:26.132 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:26.149 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:26.236 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:26.294 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:26.294 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:26.294 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:26.294 INFO:teuthology.orchestra.run.trial049.stdout: rbd-fuse-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:26.294 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:26.295 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:26.323 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-mirror 2026-02-12T10:52:26.628 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:26.710 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror x86_64 2:19.2.3-680.g05b55d19.el9 ceph 3.1 M 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 3.1 M 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 13 M 2026-02-12T10:52:26.711 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:52:27.427 INFO:teuthology.orchestra.run.trial049.stdout:rbd-mirror-19.2.3-680.g05b55d19.el9.x86_64.rpm 4.3 MB/s | 3.1 MB 00:00 2026-02-12T10:52:27.427 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:27.427 INFO:teuthology.orchestra.run.trial049.stdout:Total 4.3 MB/s | 3.1 MB 00:00 2026-02-12T10:52:27.427 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:27.431 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:27.432 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:27.473 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:27.473 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:27.666 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:27.668 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:27.691 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:27.691 INFO:teuthology.orchestra.run.trial049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T10:52:27.691 INFO:teuthology.orchestra.run.trial049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T10:52:27.691 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T10:52:27.691 INFO:teuthology.orchestra.run.trial049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T10:52:27.691 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:28.000 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:28.000 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:28.000 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:28.000 INFO:teuthology.orchestra.run.trial049.stdout: rbd-mirror-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:28.000 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:28.000 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:28.027 DEBUG:teuthology.orchestra.run.trial049:> sudo yum -y install rbd-nbd 2026-02-12T10:52:28.333 INFO:teuthology.orchestra.run.trial049.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 10:51:40 AM UTC. 2026-02-12T10:52:28.416 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T10:52:28.416 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:28.416 INFO:teuthology.orchestra.run.trial049.stdout: Package Architecture Version Repository Size 2026-02-12T10:52:28.416 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:28.416 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T10:52:28.416 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd x86_64 2:19.2.3-680.g05b55d19.el9 ceph 170 k 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout:Install 1 Package 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 170 k 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 490 k 2026-02-12T10:52:28.417 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T10:52:28.810 INFO:teuthology.orchestra.run.trial049.stdout:rbd-nbd-19.2.3-680.g05b55d19.el9.x86_64.rpm 434 kB/s | 170 kB 00:00 2026-02-12T10:52:28.810 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:28.810 INFO:teuthology.orchestra.run.trial049.stdout:Total 433 kB/s | 170 kB 00:00 2026-02-12T10:52:28.810 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T10:52:28.814 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T10:52:28.814 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T10:52:28.847 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T10:52:28.847 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T10:52:28.904 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T10:52:28.921 INFO:teuthology.orchestra.run.trial049.stdout: Installing : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:29.003 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:29.061 INFO:teuthology.orchestra.run.trial049.stdout: Verifying : rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 1/1 2026-02-12T10:52:29.061 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:29.061 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T10:52:29.061 INFO:teuthology.orchestra.run.trial049.stdout: rbd-nbd-2:19.2.3-680.g05b55d19.el9.x86_64 2026-02-12T10:52:29.062 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:52:29.062 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T10:52:29.091 DEBUG:teuthology.parallel:result is None 2026-02-12T10:52:29.091 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:29.245 DEBUG:teuthology.orchestra.run.trial028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T10:52:29.265 INFO:teuthology.orchestra.run.trial028.stdout:19.2.3-680.g05b55d19.el9 2026-02-12T10:52:29.266 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-680.g05b55d19.el9 2026-02-12T10:52:29.266 INFO:teuthology.task.install:The correct ceph version 19.2.3-680.g05b55d19 is installed. 2026-02-12T10:52:29.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:29.413 DEBUG:teuthology.orchestra.run.trial049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T10:52:29.434 INFO:teuthology.orchestra.run.trial049.stdout:19.2.3-680.g05b55d19.el9 2026-02-12T10:52:29.434 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-680.g05b55d19.el9 2026-02-12T10:52:29.435 INFO:teuthology.task.install:The correct ceph version 19.2.3-680.g05b55d19 is installed. 2026-02-12T10:52:29.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:29.582 DEBUG:teuthology.orchestra.run.trial157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T10:52:29.603 INFO:teuthology.orchestra.run.trial157.stdout:19.2.3-680.g05b55d19.el9 2026-02-12T10:52:29.603 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-680.g05b55d19.el9 2026-02-12T10:52:29.603 INFO:teuthology.task.install:The correct ceph version 19.2.3-680.g05b55d19 is installed. 2026-02-12T10:52:29.605 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T10:52:29.605 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:52:29.605 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T10:52:29.631 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:52:29.631 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T10:52:29.658 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:52:29.658 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T10:52:29.684 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T10:52:29.685 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:52:29.685 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T10:52:29.710 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T10:52:29.773 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:52:29.773 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T10:52:29.798 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T10:52:29.863 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:52:29.863 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T10:52:29.888 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T10:52:29.954 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T10:52:29.954 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:52:29.954 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T10:52:29.979 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T10:52:30.043 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:52:30.043 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T10:52:30.068 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T10:52:30.133 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:52:30.133 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T10:52:30.158 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T10:52:30.222 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T10:52:30.223 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:52:30.223 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T10:52:30.248 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T10:52:30.314 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:52:30.314 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T10:52:30.341 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T10:52:30.405 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:52:30.406 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T10:52:30.433 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T10:52:30.499 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-12T10:52:30.624 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum', 'CEPHADM_STRAY_HOST', 'CEPHADM_STRAY_DAEMON', 'CEPHADM_FAILED_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': '05b55d192f002ad5df41409624b8d176527d0841'} 2026-02-12T10:52:30.624 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:30.628 INFO:tasks.cephadm:Cluster fsid is edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:30.628 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-12T10:52:30.628 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.28', 'mon.b': '10.20.193.49', 'mon.c': '10.20.193.157'} 2026-02-12T10:52:30.628 INFO:tasks.cephadm:First mon is mon.a on trial028 2026-02-12T10:52:30.628 INFO:tasks.cephadm:First mgr is a 2026-02-12T10:52:30.628 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-12T10:52:30.628 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname $(hostname -s) 2026-02-12T10:52:30.654 DEBUG:teuthology.orchestra.run.trial049:> sudo hostname $(hostname -s) 2026-02-12T10:52:30.680 DEBUG:teuthology.orchestra.run.trial157:> sudo hostname $(hostname -s) 2026-02-12T10:52:30.705 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-12T10:52:30.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:30.856 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/flavors/default/', 'ref': 'wip-squid-pr-67199-kefu-1', 'sha1': '05b55d192f002ad5df41409624b8d176527d0841', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-08 09:09:39.435166', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-680-g05b55d19', 'package_manager_version': '19.2.3-680.g05b55d19', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2857/', 'root_build_cause': '', 'node_name': '10.20.192.93+toko03', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-12T10:52:31.000 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-squid-pr-67199-kefu-1, sha1 05b55d192f002ad5df41409624b8d176527d0841 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:31.001 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-12T10:52:31.002 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm 2026-02-12T10:52:31.002 DEBUG:teuthology.orchestra.run.trial028:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:31.797 INFO:teuthology.orchestra.run.trial028.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 12 10:52 /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:31.797 DEBUG:teuthology.orchestra.run.trial049:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:32.600 INFO:teuthology.orchestra.run.trial049.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 12 10:52 /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:32.601 DEBUG:teuthology.orchestra.run.trial157:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-squid-pr-67199-kefu-1/05b55d192f002ad5df41409624b8d176527d0841/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:33.413 INFO:teuthology.orchestra.run.trial157.stdout:-rw-r--r--. 1 ubuntu ubuntu 788305 Feb 12 10:52 /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:33.413 DEBUG:teuthology.orchestra.run.trial028:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:33.433 DEBUG:teuthology.orchestra.run.trial049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:33.451 DEBUG:teuthology.orchestra.run.trial157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-12T10:52:33.490 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 on all hosts... 2026-02-12T10:52:33.490 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-12T10:52:33.493 DEBUG:teuthology.orchestra.run.trial049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-12T10:52:33.496 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 pull 2026-02-12T10:52:33.643 INFO:teuthology.orchestra.run.trial028.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:52:33.646 INFO:teuthology.orchestra.run.trial049.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:52:33.662 INFO:teuthology.orchestra.run.trial157.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:52:41.725 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-12T10:52:41.726 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-12T10:52:41.726 INFO:teuthology.orchestra.run.trial028.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-12T10:52:41.726 INFO:teuthology.orchestra.run.trial028.stdout: "repo_digests": [ 2026-02-12T10:52:41.726 INFO:teuthology.orchestra.run.trial028.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-12T10:52:41.726 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-12T10:52:41.726 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-12T10:52:41.761 INFO:teuthology.orchestra.run.trial049.stdout:{ 2026-02-12T10:52:41.762 INFO:teuthology.orchestra.run.trial049.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-12T10:52:41.762 INFO:teuthology.orchestra.run.trial049.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-12T10:52:41.762 INFO:teuthology.orchestra.run.trial049.stdout: "repo_digests": [ 2026-02-12T10:52:41.762 INFO:teuthology.orchestra.run.trial049.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-12T10:52:41.762 INFO:teuthology.orchestra.run.trial049.stdout: ] 2026-02-12T10:52:41.762 INFO:teuthology.orchestra.run.trial049.stdout:} 2026-02-12T10:52:41.889 INFO:teuthology.orchestra.run.trial157.stdout:{ 2026-02-12T10:52:41.890 INFO:teuthology.orchestra.run.trial157.stdout: "ceph_version": "ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable)", 2026-02-12T10:52:41.890 INFO:teuthology.orchestra.run.trial157.stdout: "image_id": "dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0", 2026-02-12T10:52:41.890 INFO:teuthology.orchestra.run.trial157.stdout: "repo_digests": [ 2026-02-12T10:52:41.890 INFO:teuthology.orchestra.run.trial157.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90" 2026-02-12T10:52:41.890 INFO:teuthology.orchestra.run.trial157.stdout: ] 2026-02-12T10:52:41.890 INFO:teuthology.orchestra.run.trial157.stdout:} 2026-02-12T10:52:41.906 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /etc/ceph 2026-02-12T10:52:41.935 DEBUG:teuthology.orchestra.run.trial049:> sudo mkdir -p /etc/ceph 2026-02-12T10:52:41.963 DEBUG:teuthology.orchestra.run.trial157:> sudo mkdir -p /etc/ceph 2026-02-12T10:52:41.989 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 777 /etc/ceph 2026-02-12T10:52:42.015 DEBUG:teuthology.orchestra.run.trial049:> sudo chmod 777 /etc/ceph 2026-02-12T10:52:42.040 DEBUG:teuthology.orchestra.run.trial157:> sudo chmod 777 /etc/ceph 2026-02-12T10:52:42.066 INFO:tasks.cephadm:Writing seed config... 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-12T10:52:42.068 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-12T10:52:42.069 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-12T10:52:42.070 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:52:42.070 DEBUG:teuthology.orchestra.run.trial028:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-12T10:52:42.086 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = edb480c7-0800-11f1-86ba-d404e6e7d460 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2026-02-12T10:52:42.086 DEBUG:teuthology.orchestra.run.trial028:mon.a> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a.service 2026-02-12T10:52:42.129 DEBUG:teuthology.orchestra.run.trial028:mgr.a> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.a.service 2026-02-12T10:52:42.172 INFO:tasks.cephadm:Bootstrapping... 2026-02-12T10:52:42.172 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 -v bootstrap --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.28 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:52:42.308 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-12T10:52:42.308 INFO:teuthology.orchestra.run.trial028.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841', '-v', 'bootstrap', '--fsid', 'edb480c7-0800-11f1-86ba-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.28', '--skip-admin-label'] 2026-02-12T10:52:42.309 INFO:teuthology.orchestra.run.trial028.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-12T10:52:42.309 INFO:teuthology.orchestra.run.trial028.stdout:Verifying podman|docker is present... 2026-02-12T10:52:42.324 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-12T10:52:42.324 INFO:teuthology.orchestra.run.trial028.stdout:Verifying lvm2 is present... 2026-02-12T10:52:42.324 INFO:teuthology.orchestra.run.trial028.stdout:Verifying time synchronization is in place... 2026-02-12T10:52:42.330 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-12T10:52:42.330 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-12T10:52:42.336 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-12T10:52:42.336 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-12T10:52:42.342 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-12T10:52:42.348 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-12T10:52:42.348 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-12T10:52:42.348 INFO:teuthology.orchestra.run.trial028.stdout:Repeating the final host check... 2026-02-12T10:52:42.363 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-12T10:52:42.363 INFO:teuthology.orchestra.run.trial028.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-12T10:52:42.364 INFO:teuthology.orchestra.run.trial028.stdout:systemctl is present 2026-02-12T10:52:42.364 INFO:teuthology.orchestra.run.trial028.stdout:lvcreate is present 2026-02-12T10:52:42.369 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-12T10:52:42.369 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-12T10:52:42.374 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-12T10:52:42.374 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-12T10:52:42.380 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-12T10:52:42.386 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-12T10:52:42.387 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-12T10:52:42.387 INFO:teuthology.orchestra.run.trial028.stdout:Host looks OK 2026-02-12T10:52:42.387 INFO:teuthology.orchestra.run.trial028.stdout:Cluster fsid: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:42.387 INFO:teuthology.orchestra.run.trial028.stdout:Acquiring lock 139731973692864 on /run/cephadm/edb480c7-0800-11f1-86ba-d404e6e7d460.lock 2026-02-12T10:52:42.387 INFO:teuthology.orchestra.run.trial028.stdout:Lock 139731973692864 acquired on /run/cephadm/edb480c7-0800-11f1-86ba-d404e6e7d460.lock 2026-02-12T10:52:42.387 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 3300 ... 2026-02-12T10:52:42.388 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 6789 ... 2026-02-12T10:52:42.388 INFO:teuthology.orchestra.run.trial028.stdout:Base mon IP(s) is [10.20.193.28:3300, 10.20.193.28:6789], mon addrv is [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-12T10:52:42.390 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.28 metric 102 2026-02-12T10:52:42.390 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.28 metric 102 2026-02-12T10:52:42.390 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-12T10:52:42.393 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-12T10:52:42.393 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-12T10:52:42.393 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-12T10:52:42.396 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-12T10:52:42.396 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-12T10:52:42.396 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-12T10:52:42.396 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 fe80::6559:755f:4ebe:5495/64 scope link noprefixroute 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:630c/64 scope link 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-12T10:52:42.397 INFO:teuthology.orchestra.run.trial028.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:52:42.648 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-12T10:52:42.648 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841... 2026-02-12T10:52:42.648 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Getting image source signatures 2026-02-12T10:52:42.648 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:a10ade7902ac0ef76ec881f51088d9f38168c6983473ae266a7fda42a3d99f76 2026-02-12T10:52:42.648 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:c92ccfe8c151fb35c12ff15a7a7de08028e120d73814d436eadc192e84f49ad9 2026-02-12T10:52:42.649 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying config sha256:dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 2026-02-12T10:52:42.649 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-12T10:52:42.779 INFO:teuthology.orchestra.run.trial028.stdout:ceph: stdout ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-12T10:52:42.780 INFO:teuthology.orchestra.run.trial028.stdout:Ceph version: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable) 2026-02-12T10:52:42.780 INFO:teuthology.orchestra.run.trial028.stdout:Extracting ceph user uid/gid from container image... 2026-02-12T10:52:42.906 INFO:teuthology.orchestra.run.trial028.stdout:stat: stdout 167 167 2026-02-12T10:52:42.907 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial keys... 2026-02-12T10:52:43.015 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQD6sI1p8xuYOxAAXzCgBG1E27nY7S+3jw4ixw== 2026-02-12T10:52:43.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQD7sI1p8fh1BhAAa3Nhh1laYeTVmGAfor+fZQ== 2026-02-12T10:52:43.247 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQD7sI1p0I/ZDBAA3RzfDKBtqatf+PclogcNUQ== 2026-02-12T10:52:43.247 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial monmap... 2026-02-12T10:52:43.376 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool for a [v2:10.20.193.28:3300,v1:10.20.193.28:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:setting min_mon_release = quincy 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: set fsid to edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:52:43.377 INFO:teuthology.orchestra.run.trial028.stdout:Creating mon... 2026-02-12T10:52:43.508 INFO:teuthology.orchestra.run.trial028.stdout:create mon.a on 2026-02-12T10:52:43.674 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-12T10:52:43.772 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-12T10:52:43.875 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460.target → /etc/systemd/system/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460.target. 2026-02-12T10:52:43.875 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460.target → /etc/systemd/system/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460.target. 2026-02-12T10:52:43.999 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a 2026-02-12T10:52:43.999 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a.service: Unit ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a.service not loaded. 2026-02-12T10:52:44.119 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460.target.wants/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@.service. 2026-02-12T10:52:44.256 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 podman[20702]: 2026-02-12 10:52:44.253081838 +0000 UTC m=+0.046740452 container start c1aa2c76d117f1aa21d329e618f42d761af6fa2a5972902b9a74d52af4151c0d (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.build-date=20260202, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-12T10:52:44.270 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:52:44.270 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-12T10:52:44.276 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:52:44.276 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-12T10:52:44.276 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-12T10:52:44.276 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-12T10:52:44.276 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon to start... 2026-02-12T10:52:44.277 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon... 2026-02-12T10:52:44.426 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout cluster: 2026-02-12T10:52:44.426 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout id: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:44.426 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-12T10:52:44.426 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout services: 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.125895s) 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout data: 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pgs: 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:44.427 INFO:teuthology.orchestra.run.trial028.stdout:mon is available 2026-02-12T10:52:44.428 INFO:teuthology.orchestra.run.trial028.stdout:Assimilating anything we can from ceph.conf... 2026-02-12T10:52:44.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 bash[20702]: c1aa2c76d117f1aa21d329e618f42d761af6fa2a5972902b9a74d52af4151c0d 2026-02-12T10:52:44.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 podman[20702]: 2026-02-12 10:52:44.215907211 +0000 UTC m=+0.009565835 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:44.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 systemd[1]: Started Ceph mon.a for edb480c7-0800-11f1-86ba-d404e6e7d460. 2026-02-12T10:52:44.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 ceph-mon[20730]: mkfs edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:44.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 ceph-mon[20730]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-12T10:52:44.573 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = True 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-12T10:52:44.574 INFO:teuthology.orchestra.run.trial028.stdout:Generating new minimal ceph.conf... 2026-02-12T10:52:44.734 INFO:teuthology.orchestra.run.trial028.stdout:Restarting the monitor... 2026-02-12T10:52:44.815 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 systemd[1]: Stopping Ceph mon.a for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:52:45.079 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a[20726]: 2026-02-12T10:52:44.810+0000 7ffb5dd08640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:52:45.079 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a[20726]: 2026-02-12T10:52:44.810+0000 7ffb5dd08640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-12T10:52:45.079 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 podman[21011]: 2026-02-12 10:52:44.902354374 +0000 UTC m=+0.103850422 container died c1aa2c76d117f1aa21d329e618f42d761af6fa2a5972902b9a74d52af4151c0d (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-12T10:52:45.079 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 podman[21011]: 2026-02-12 10:52:44.910635853 +0000 UTC m=+0.112131902 container remove c1aa2c76d117f1aa21d329e618f42d761af6fa2a5972902b9a74d52af4151c0d (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7) 2026-02-12T10:52:45.079 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 bash[21011]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a 2026-02-12T10:52:45.079 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 systemd[1]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-12T10:52:45.079 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 systemd[1]: Stopped Ceph mon.a for edb480c7-0800-11f1-86ba-d404e6e7d460. 2026-02-12T10:52:45.080 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:44 trial028 systemd[1]: Starting Ceph mon.a for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:52:45.080 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 podman[21139]: 2026-02-12 10:52:45.049750834 +0000 UTC m=+0.015635819 container create 668ce32576298934993bd2c8dea197ed15f4449282d4472ec1366d6dd4a69725 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-12T10:52:45.087 INFO:teuthology.orchestra.run.trial028.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-12T10:52:45.244 INFO:teuthology.orchestra.run.trial028.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-12T10:52:45.245 INFO:teuthology.orchestra.run.trial028.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:52:45.245 INFO:teuthology.orchestra.run.trial028.stdout:Creating mgr... 2026-02-12T10:52:45.246 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-12T10:52:45.246 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-12T10:52:45.371 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.a 2026-02-12T10:52:45.371 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.a.service: Unit ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.a.service not loaded. 2026-02-12T10:52:45.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 podman[21139]: 2026-02-12 10:52:45.077320574 +0000 UTC m=+0.043205498 container init 668ce32576298934993bd2c8dea197ed15f4449282d4472ec1366d6dd4a69725 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a, org.label-schema.build-date=20260202, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-12T10:52:45.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 podman[21139]: 2026-02-12 10:52:45.07954773 +0000 UTC m=+0.045432664 container start 668ce32576298934993bd2c8dea197ed15f4449282d4472ec1366d6dd4a69725 (image=quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-12T10:52:45.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 bash[21139]: 668ce32576298934993bd2c8dea197ed15f4449282d4472ec1366d6dd4a69725 2026-02-12T10:52:45.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 podman[21139]: 2026-02-12 10:52:45.043052255 +0000 UTC m=+0.008937179 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 2026-02-12T10:52:45.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 systemd[1]: Started Ceph mon.a for edb480c7-0800-11f1-86ba-d404e6e7d460. 2026-02-12T10:52:45.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: set uid:gid to 167:167 (ceph:ceph) 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: ceph version 19.2.3-680-g05b55d19 (05b55d192f002ad5df41409624b8d176527d0841) squid (stable), process ceph-mon, pid 2 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: pidfile_write: ignore empty --pid-file 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: load: jerasure load: lrc 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: RocksDB version: 7.9.2 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Git sha 0 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Compile date 2026-02-08 08:28:36 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: DB SUMMARY 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: DB Session ID: 9I9C76A91ES8BX7KKG86 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: CURRENT file: CURRENT 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: IDENTITY file: IDENTITY 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-12T10:52:45.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 74983 ; 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.error_if_exists: 0 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.create_if_missing: 0 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.paranoid_checks: 1 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.env: 0x5615b7a16dc0 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.fs: PosixFileSystem 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.info_log: 0x5615b8477880 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_file_opening_threads: 16 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.statistics: (nil) 2026-02-12T10:52:45.380 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.use_fsync: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_log_file_size: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.keep_log_file_num: 1000 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.recycle_log_file_num: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.allow_fallocate: 1 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.allow_mmap_reads: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.allow_mmap_writes: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.use_direct_reads: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.create_missing_column_families: 0 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.db_log_dir: 2026-02-12T10:52:45.381 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.wal_dir: 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.advise_random_on_open: 1 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.db_write_buffer_size: 0 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.write_buffer_manager: 0x5615b847b900 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-12T10:52:45.382 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.rate_limiter: (nil) 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.wal_recovery_mode: 2 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.enable_thread_tracking: 0 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.enable_pipelined_write: 0 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.unordered_write: 0 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.row_cache: None 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.wal_filter: None 2026-02-12T10:52:45.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.allow_ingest_behind: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.two_write_queues: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.manual_wal_flush: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.wal_compression: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.atomic_flush: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.log_readahead_size: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.best_efforts_recovery: 0 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-12T10:52:45.384 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.allow_data_in_errors: 0 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.db_host_id: __hostname__ 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_background_jobs: 2 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_background_compactions: -1 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_subcompactions: 1 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_total_wal_size: 0 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-12T10:52:45.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_open_files: -1 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bytes_per_sync: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_readahead_size: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_background_flushes: -1 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Compression algorithms supported: 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kZSTD supported: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kXpressCompression supported: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kBZip2Compression supported: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-12T10:52:45.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kLZ4Compression supported: 1 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kZlibCompression supported: 1 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kLZ4HCCompression supported: 1 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: kSnappyCompression supported: 1 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.merge_operator: 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_filter: None 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_filter_factory: None 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.sst_partitioner_factory: None 2026-02-12T10:52:45.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5615b8476480) 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks: 1 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_top_level_index_and_filter: 1 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: index_type: 0 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_index_type: 0 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: index_shortening: 1 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: checksum: 4 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: no_block_cache: 0 2026-02-12T10:52:45.388 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache: 0x5615b849b350 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_name: BinnedLRUCache 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_options: 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: capacity : 536870912 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: num_shard_bits : 4 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: strict_capacity_limit : 0 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: high_pri_pool_ratio: 0.000 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_compressed: (nil) 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: persistent_cache: (nil) 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size: 4096 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size_deviation: 10 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: block_restart_interval: 16 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: index_block_restart_interval: 1 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: metadata_block_size: 4096 2026-02-12T10:52:45.389 INFO:journalctl@ceph.mon.a.trial028.stdout: partition_filters: 0 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: use_delta_encoding: 1 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: filter_policy: bloomfilter 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: whole_key_filtering: 1 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: verify_compression: 0 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: read_amp_bytes_per_bit: 0 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: format_version: 5 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_index_compression: 1 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: block_align: 0 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: max_auto_readahead_size: 262144 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: prepopulate_block_cache: 0 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: initial_auto_readahead_size: 8192 2026-02-12T10:52:45.390 INFO:journalctl@ceph.mon.a.trial028.stdout: num_file_reads_for_auto_readahead: 2 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.write_buffer_size: 33554432 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_write_buffer_number: 2 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression: NoCompression 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression: Disabled 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.prefix_extractor: nullptr 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.num_levels: 7 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-12T10:52:45.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.level: 32767 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.strategy: 0 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-12T10:52:45.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.enabled: false 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.target_file_size_base: 67108864 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-12T10:52:45.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.arena_block_size: 1048576 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.disable_auto_compactions: 0 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-12T10:52:45.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.inplace_update_support: 0 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-12T10:52:45.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.bloom_locality: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.max_successive_merges: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.paranoid_file_checks: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.force_consistency_checks: 1 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.report_bg_io_stats: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.ttl: 2592000 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.enable_blob_files: false 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.min_blob_size: 0 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.blob_file_size: 268435456 2026-02-12T10:52:45.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.blob_file_starting_level: 0 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2a238816-64d0-45cb-a442-1ee4fc1d5aed 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770893565098042, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770893565098898, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 72124, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 223, "table_properties": {"data_size": 70395, "index_size": 178, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 9550, "raw_average_key_size": 49, "raw_value_size": 64967, "raw_average_value_size": 334, "num_data_blocks": 8, "num_entries": 194, "num_filter_entries": 194, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770893565, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2a238816-64d0-45cb-a442-1ee4fc1d5aed", "db_session_id": "9I9C76A91ES8BX7KKG86", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-12T10:52:45.397 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770893565098947, "job": 1, "event": "recovery_finished"} 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5615b849ce00 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: DB pointer 0x5615b85a8000 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout: ** DB Stats ** 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-12T10:52:45.398 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: L0 2/0 72.29 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: Sum 2/0 72.29 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-12T10:52:45.399 INFO:journalctl@ceph.mon.a.trial028.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 105.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-12T10:52:45.400 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative compaction: 0.00 GB write, 27.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval compaction: 0.00 GB write, 27.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache BinnedLRUCache@0x5615b849b350#2 capacity: 512.00 MB usage: 1.08 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.70 KB,0.00013411%) IndexBlock(2,0.38 KB,7.15256e-05%) Misc(1,0.00 KB,0%) 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: starting mon.a rank 0 at public addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] at bind addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???) e1 preinit fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???).mds e1 new map 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???).mds e1 print_map 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: e1 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: btime 2026-02-12T10:52:44:278375+0000 2026-02-12T10:52:45.401 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout: legacy client fscid: -1 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout: No filesystems configured 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: monmap epoch 1 2026-02-12T10:52:45.402 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: last_changed 2026-02-12T10:52:43.350494+0000 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: min_mon_release 19 (squid) 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: election_strategy: 1 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: fsmap 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: osdmap e1: 0 total, 0 up, 0 in 2026-02-12T10:52:45.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:45 trial028 ceph-mon[21167]: mgrmap e1: no daemons active 2026-02-12T10:52:45.485 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460.target.wants/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@.service. 2026-02-12T10:52:45.626 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:52:45.626 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-12T10:52:45.632 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:52:45.632 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-12T10:52:45.632 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-12T10:52:45.632 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-12T10:52:45.639 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:52:45.639 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-12T10:52:45.645 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:52:45.645 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-12T10:52:45.645 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-12T10:52:45.646 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-12T10:52:45.646 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr to start... 2026-02-12T10:52:45.646 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr... 2026-02-12T10:52:45.672 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:45 trial028 systemd[1]: Started Ceph mgr.a for edb480c7-0800-11f1-86ba-d404e6e7d460. 2026-02-12T10:52:45.808 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "edb480c7-0800-11f1-86ba-d404e6e7d460", 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-12T10:52:45.811 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-12T10:52:44:278375+0000", 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:45.812 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "restful" 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-12T10:52:44.278773+0000", 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:52:45.813 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (1/15)... 2026-02-12T10:52:46.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2401191272' entity='client.admin' 2026-02-12T10:52:46.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3774645560' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-12T10:52:46.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:45.998+0000 7f9b7e0ee140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-12T10:52:46.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.140+0000 7f9b7e0ee140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-12T10:52:46.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.173+0000 7f9b7e0ee140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-12T10:52:46.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.214+0000 7f9b7e0ee140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-12T10:52:46.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.244+0000 7f9b7e0ee140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.277+0000 7f9b7e0ee140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.342+0000 7f9b7e0ee140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: from numpy import show_config as show_numpy_config 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.414+0000 7f9b7e0ee140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.447+0000 7f9b7e0ee140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-12T10:52:46.545 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.541+0000 7f9b7e0ee140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-12T10:52:46.966 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.598+0000 7f9b7e0ee140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-12T10:52:46.966 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.630+0000 7f9b7e0ee140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-12T10:52:46.966 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.662+0000 7f9b7e0ee140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-12T10:52:46.966 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.695+0000 7f9b7e0ee140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-12T10:52:46.966 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.725+0000 7f9b7e0ee140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-12T10:52:46.966 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:46 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:46.962+0000 7f9b7e0ee140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-12T10:52:47.242 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.059+0000 7f9b7e0ee140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-12T10:52:47.242 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.089+0000 7f9b7e0ee140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-12T10:52:47.242 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.119+0000 7f9b7e0ee140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-12T10:52:47.243 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.210+0000 7f9b7e0ee140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:52:47.243 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.238+0000 7f9b7e0ee140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-12T10:52:47.528 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.329+0000 7f9b7e0ee140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "edb480c7-0800-11f1-86ba-d404e6e7d460", 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-12T10:52:47.968 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-12T10:52:44:278375+0000", 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "restful" 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-12T10:52:44.278773+0000", 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:52:47.969 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (2/15)... 2026-02-12T10:52:48.218 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/16060746' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-12T10:52:48.218 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.788+0000 7f9b7e0ee140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-12T10:52:48.218 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:47.816+0000 7f9b7e0ee140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-12T10:52:48.528 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:48.213+0000 7f9b7e0ee140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: Activating manager daemon a 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: mgrmap e2: a(active, starting, since 0.00232528s) 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-12T10:52:49.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: Manager daemon a is now available 2026-02-12T10:52:49.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-12T10:52:49.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-12T10:52:49.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' 2026-02-12T10:52:49.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' 2026-02-12T10:52:49.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:48 trial028 ceph-mon[21167]: from='mgr.14100 10.20.193.28:0/248089614' entity='mgr.a' 2026-02-12T10:52:50.211 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:50.211 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:52:50.211 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "edb480c7-0800-11f1-86ba-d404e6e7d460", 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-12T10:52:50.212 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-12T10:52:50.213 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-12T10:52:50.214 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-12T10:52:44:278375+0000", 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-12T10:52:50.215 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "restful" 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-12T10:52:44.278773+0000", 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:52:50.216 INFO:teuthology.orchestra.run.trial028.stdout:mgr is available 2026-02-12T10:52:50.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:50 trial028 ceph-mon[21167]: mgrmap e3: a(active, since 1.00432s) 2026-02-12T10:52:50.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:50 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/157131019' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-12T10:52:50.422 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:50.422 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-12T10:52:50.423 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-12T10:52:50.424 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-12T10:52:50.424 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-12T10:52:50.424 INFO:teuthology.orchestra.run.trial028.stdout:Enabling cephadm module... 2026-02-12T10:52:51.474 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-mon[21167]: mgrmap e4: a(active, since 2s) 2026-02-12T10:52:51.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3653190193' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-12T10:52:51.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3653190193' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-12T10:52:51.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/564630797' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-12T10:52:51.475 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: ignoring --setuser ceph since I am not root 2026-02-12T10:52:51.475 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: ignoring --setgroup ceph since I am not root 2026-02-12T10:52:51.659 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:52:51.660 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-12T10:52:51.660 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-12T10:52:51.660 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-12T10:52:51.660 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-12T10:52:51.660 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:52:51.660 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-12T10:52:51.660 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 5... 2026-02-12T10:52:52.026 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:51.805+0000 7f4b03e5e140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-12T10:52:52.026 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:51.948+0000 7f4b03e5e140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-12T10:52:52.026 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:51 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:51.981+0000 7f4b03e5e140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-12T10:52:52.026 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.021+0000 7f4b03e5e140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-12T10:52:52.278 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.051+0000 7f4b03e5e140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-12T10:52:52.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.084+0000 7f4b03e5e140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-12T10:52:52.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.149+0000 7f4b03e5e140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-12T10:52:52.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T10:52:52.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T10:52:52.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: from numpy import show_config as show_numpy_config 2026-02-12T10:52:52.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.221+0000 7f4b03e5e140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-12T10:52:52.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.254+0000 7f4b03e5e140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-12T10:52:52.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/564630797' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-12T10:52:52.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-mon[21167]: mgrmap e5: a(active, since 3s) 2026-02-12T10:52:52.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2433602332' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-12T10:52:52.769 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.348+0000 7f4b03e5e140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-12T10:52:52.769 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.405+0000 7f4b03e5e140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-12T10:52:52.770 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.438+0000 7f4b03e5e140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-12T10:52:52.770 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.470+0000 7f4b03e5e140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-12T10:52:52.770 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.503+0000 7f4b03e5e140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-12T10:52:52.770 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.533+0000 7f4b03e5e140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-12T10:52:52.770 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.764+0000 7f4b03e5e140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-12T10:52:53.019 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.862+0000 7f4b03e5e140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-12T10:52:53.019 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.892+0000 7f4b03e5e140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-12T10:52:53.019 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:52.922+0000 7f4b03e5e140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-12T10:52:53.019 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:53 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:53.014+0000 7f4b03e5e140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:52:53.278 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:53 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:53.042+0000 7f4b03e5e140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-12T10:52:53.278 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:53 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:53.133+0000 7f4b03e5e140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:52:54.018 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:53 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:53.593+0000 7f4b03e5e140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-12T10:52:54.018 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:53 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:53.622+0000 7f4b03e5e140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-12T10:52:54.018 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:54.013+0000 7f4b03e5e140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-12T10:52:54.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: Active manager daemon a restarted 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: Activating manager daemon a 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: osdmap e2: 0 total, 0 up, 0 in 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: mgrmap e6: a(active, starting, since 0.00245895s) 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: Manager daemon a is now available 2026-02-12T10:52:54.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:54.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:54.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:54.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:52:54.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:52:54.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-12T10:52:54.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:54 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-12T10:52:55.048 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:52:55.049 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-12T10:52:55.049 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-12T10:52:55.049 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:52:55.049 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 5 is available 2026-02-12T10:52:55.049 INFO:teuthology.orchestra.run.trial028.stdout:Setting orchestrator backend to cephadm... 2026-02-12T10:52:55.464 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-12T10:52:55.464 INFO:teuthology.orchestra.run.trial028.stdout:Generating ssh key... 2026-02-12T10:52:55.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-mon[21167]: Found migration_current of "None". Setting to last migration. 2026-02-12T10:52:55.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:55.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:55.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-mon[21167]: mgrmap e7: a(active, since 1.00338s) 2026-02-12T10:52:55.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:55.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:52:55.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:52:55.861 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Generating public/private ed25519 key pair. 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Your identification has been saved in /tmp/tmpuq7l1iz_/key 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Your public key has been saved in /tmp/tmpuq7l1iz_/key.pub 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: The key fingerprint is: 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: SHA256:tmzPqdHr4IIm5DfWWQ90uzwikAwUhgLJztUkrmkKEgM ceph-edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: The key's randomart image is: 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: +--[ED25519 256]--+ 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: |Eoooo. | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: |=oo... | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: |*... | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: | =+ . . | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: |o+ o . .S. . | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: |= . + ooo. | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: |.o + o*+.. | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: | o * =o.==o | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: | = . oo+*. | 2026-02-12T10:52:55.862 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:55 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: +----[SHA256]-----+ 2026-02-12T10:52:55.879 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIYtOqLUBGuuEX0IEQYZ7P0wjGKjIiJSQux1iQ1snLSn ceph-edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:52:55.880 INFO:teuthology.orchestra.run.trial028.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-12T10:52:55.880 INFO:teuthology.orchestra.run.trial028.stdout:Adding key to root@localhost authorized_keys... 2026-02-12T10:52:55.881 INFO:teuthology.orchestra.run.trial028.stdout:Adding host trial028... 2026-02-12T10:52:56.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-12T10:52:56.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-12T10:52:56.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: [12/Feb/2026:10:52:55] ENGINE Bus STARTING 2026-02-12T10:52:56.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: [12/Feb/2026:10:52:55] ENGINE Serving on http://10.20.193.28:8765 2026-02-12T10:52:56.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:52:56.389 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: [12/Feb/2026:10:52:55] ENGINE Serving on https://10.20.193.28:7150 2026-02-12T10:52:56.389 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: [12/Feb/2026:10:52:55] ENGINE Bus STARTED 2026-02-12T10:52:56.389 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: [12/Feb/2026:10:52:55] ENGINE Client ('10.20.193.28', 32818) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-12T10:52:56.389 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:52:56.389 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:56.389 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:56 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:57.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:57 trial028 ceph-mon[21167]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:52:57.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:57 trial028 ceph-mon[21167]: Generating ssh key... 2026-02-12T10:52:57.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:57 trial028 ceph-mon[21167]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:52:57.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:57 trial028 ceph-mon[21167]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:52:57.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:57 trial028 ceph-mon[21167]: mgrmap e8: a(active, since 2s) 2026-02-12T10:52:57.592 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Added host 'trial028' with addr '10.20.193.28' 2026-02-12T10:52:57.593 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mon service... 2026-02-12T10:52:57.829 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-12T10:52:57.829 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mgr service... 2026-02-12T10:52:58.053 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: Deploying cephadm binary to trial028 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:58.378 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:58 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/1626875610' entity='client.admin' 2026-02-12T10:52:58.479 INFO:teuthology.orchestra.run.trial028.stdout:Enabling the dashboard module... 2026-02-12T10:52:59.587 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: Added host trial028 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: Saving service mon spec with placement count:5 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: Saving service mgr spec with placement count:2 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2891641131' entity='client.admin' 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.trial028", "caps": []}]: dispatch 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='mgr.14118 10.20.193.28:0/2954837190' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.trial028", "caps": []}]': finished 2026-02-12T10:52:59.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/4093646655' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-12T10:52:59.841 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: ignoring --setuser ceph since I am not root 2026-02-12T10:52:59.841 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: ignoring --setgroup ceph since I am not root 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-12T10:52:59.870 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 9... 2026-02-12T10:53:00.132 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:52:59 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:52:59.985+0000 7fa996a9c140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-12T10:53:00.132 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.127+0000 7fa996a9c140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-12T10:53:00.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-mon[21167]: Deploying daemon agent.trial028 on trial028 2026-02-12T10:53:00.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/4093646655' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-12T10:53:00.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-mon[21167]: mgrmap e9: a(active, since 5s) 2026-02-12T10:53:00.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2129569334' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-12T10:53:00.405 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.161+0000 7fa996a9c140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-12T10:53:00.405 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.201+0000 7fa996a9c140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-12T10:53:00.405 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.232+0000 7fa996a9c140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-12T10:53:00.405 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.265+0000 7fa996a9c140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-12T10:53:00.405 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.330+0000 7fa996a9c140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-12T10:53:00.406 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T10:53:00.406 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T10:53:00.406 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: from numpy import show_config as show_numpy_config 2026-02-12T10:53:00.657 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.403+0000 7fa996a9c140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-12T10:53:00.658 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.436+0000 7fa996a9c140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-12T10:53:00.658 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.530+0000 7fa996a9c140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-12T10:53:00.658 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.587+0000 7fa996a9c140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-12T10:53:00.658 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.621+0000 7fa996a9c140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-12T10:53:00.658 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.653+0000 7fa996a9c140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-12T10:53:00.954 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.687+0000 7fa996a9c140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-12T10:53:00.954 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.717+0000 7fa996a9c140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-12T10:53:00.954 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:00 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:00.950+0000 7fa996a9c140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-12T10:53:01.231 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.048+0000 7fa996a9c140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-12T10:53:01.231 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.077+0000 7fa996a9c140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-12T10:53:01.231 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.107+0000 7fa996a9c140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-12T10:53:01.231 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.199+0000 7fa996a9c140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:53:01.231 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.227+0000 7fa996a9c140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-12T10:53:01.528 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.318+0000 7fa996a9c140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:53:02.201 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.778+0000 7fa996a9c140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-12T10:53:02.202 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:01 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:01.807+0000 7fa996a9c140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-12T10:53:02.202 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:53:02.197+0000 7fa996a9c140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-12T10:53:02.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: Active manager daemon a restarted 2026-02-12T10:53:02.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: Activating manager daemon a 2026-02-12T10:53:02.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: osdmap e3: 0 total, 0 up, 0 in 2026-02-12T10:53:02.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: mgrmap e10: a(active, starting, since 0.00278405s) 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: Manager daemon a is now available 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-12T10:53:02.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-12T10:53:03.249 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-12T10:53:03.249 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-12T10:53:03.249 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-12T10:53:03.249 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-12T10:53:03.249 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 9 is available 2026-02-12T10:53:03.249 INFO:teuthology.orchestra.run.trial028.stdout:Generating a dashboard self-signed certificate... 2026-02-12T10:53:03.620 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-12T10:53:03.620 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial admin user... 2026-02-12T10:53:04.021 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.trial028", "caps": []}]: dispatch 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: [12/Feb/2026:10:53:03] ENGINE Bus STARTING 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: [12/Feb/2026:10:53:03] ENGINE Serving on http://10.20.193.28:8765 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: mgrmap e11: a(active, since 1.00371s) 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: [12/Feb/2026:10:53:03] ENGINE Serving on https://10.20.193.28:7150 2026-02-12T10:53:04.022 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: [12/Feb/2026:10:53:03] ENGINE Bus STARTED 2026-02-12T10:53:04.023 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: [12/Feb/2026:10:53:03] ENGINE Client ('10.20.193.28', 32846) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-12T10:53:04.023 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:04.023 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: Deploying daemon agent.trial028 on trial028 2026-02-12T10:53:04.023 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:04.023 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:04.041 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$PdTSC4xfk8tZ4RKK1ZTVKOFM6x2fj0nkFMnwybJ7z0RheGMCyJ4bW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1770893584, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-12T10:53:04.042 INFO:teuthology.orchestra.run.trial028.stdout:Fetching dashboard port number... 2026-02-12T10:53:04.241 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 8443 2026-02-12T10:53:04.250 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-12T10:53:04.250 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-12T10:53:04.256 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-12T10:53:04.256 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-12T10:53:04.256 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-12T10:53:04.257 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-12T10:53:04.257 INFO:teuthology.orchestra.run.trial028.stdout:Ceph Dashboard is now available at: 2026-02-12T10:53:04.257 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.257 INFO:teuthology.orchestra.run.trial028.stdout: URL: https://trial028:8443/ 2026-02-12T10:53:04.258 INFO:teuthology.orchestra.run.trial028.stdout: User: admin 2026-02-12T10:53:04.258 INFO:teuthology.orchestra.run.trial028.stdout: Password: c0lrmphkvm 2026-02-12T10:53:04.258 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.258 INFO:teuthology.orchestra.run.trial028.stdout:Saving cluster configuration to /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config directory 2026-02-12T10:53:04.509 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout:Or, if you are only running a single cluster on this host: 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.510 INFO:teuthology.orchestra.run.trial028.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout: ceph telemetry on 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout:For more information see: 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:04.511 INFO:teuthology.orchestra.run.trial028.stdout:Bootstrap complete. 2026-02-12T10:53:04.538 INFO:tasks.cephadm:Fetching config... 2026-02-12T10:53:04.539 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:53:04.539 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-12T10:53:04.557 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-12T10:53:04.557 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:53:04.557 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-12T10:53:04.616 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-12T10:53:04.616 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:53:04.616 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-12T10:53:04.686 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-12T10:53:04.686 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:53:04.686 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-12T10:53:04.748 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-12T10:53:04.748 DEBUG:teuthology.orchestra.run.trial028:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIYtOqLUBGuuEX0IEQYZ7P0wjGKjIiJSQux1iQ1snLSn ceph-edb480c7-0800-11f1-86ba-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-12T10:53:04.832 INFO:teuthology.orchestra.run.trial028.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIYtOqLUBGuuEX0IEQYZ7P0wjGKjIiJSQux1iQ1snLSn ceph-edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:04.843 DEBUG:teuthology.orchestra.run.trial049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIYtOqLUBGuuEX0IEQYZ7P0wjGKjIiJSQux1iQ1snLSn ceph-edb480c7-0800-11f1-86ba-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-12T10:53:04.876 INFO:teuthology.orchestra.run.trial049.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIYtOqLUBGuuEX0IEQYZ7P0wjGKjIiJSQux1iQ1snLSn ceph-edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:04.886 DEBUG:teuthology.orchestra.run.trial157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIYtOqLUBGuuEX0IEQYZ7P0wjGKjIiJSQux1iQ1snLSn ceph-edb480c7-0800-11f1-86ba-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-12T10:53:04.921 INFO:teuthology.orchestra.run.trial157.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIYtOqLUBGuuEX0IEQYZ7P0wjGKjIiJSQux1iQ1snLSn ceph-edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:04.931 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-12T10:53:05.094 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:05 trial028 ceph-mon[21167]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:05.095 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:05.095 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:05 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3719639634' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-12T10:53:05.095 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:05 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3289218406' entity='client.admin' 2026-02-12T10:53:05.142 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:05.384 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-12T10:53:05.384 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-12T10:53:05.539 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:05.999 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial049 2026-02-12T10:53:06.000 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:53:06.000 DEBUG:teuthology.orchestra.run.trial049:> dd of=/etc/ceph/ceph.conf 2026-02-12T10:53:06.018 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:53:06.018 DEBUG:teuthology.orchestra.run.trial049:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:06.074 INFO:tasks.cephadm:Adding host trial049 to orchestrator... 2026-02-12T10:53:06.074 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch host add trial049 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: mgrmap e12: a(active, since 2s) 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3727820270' entity='client.admin' 2026-02-12T10:53:06.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:06.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:06.280 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: Updating trial028:/etc/ceph/ceph.conf 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: Updating trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: Updating trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:07.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:07.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:08.187 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial049' with addr '10.20.193.49' 2026-02-12T10:53:08.246 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-12T10:53:08.396 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:08.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:08 trial028 ceph-mon[21167]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial049", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:08.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:08 trial028 ceph-mon[21167]: Deploying cephadm binary to trial049 2026-02-12T10:53:08.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:08 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:08.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:08 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:08.588 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:08.588 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.49", "hostname": "trial049", "labels": [], "status": ""}] 2026-02-12T10:53:08.624 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial157 2026-02-12T10:53:08.625 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:53:08.625 DEBUG:teuthology.orchestra.run.trial157:> dd of=/etc/ceph/ceph.conf 2026-02-12T10:53:08.643 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:53:08.644 DEBUG:teuthology.orchestra.run.trial157:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:08.702 INFO:tasks.cephadm:Adding host trial157 to orchestrator... 2026-02-12T10:53:08.702 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch host add trial157 2026-02-12T10:53:08.851 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: Added host trial049 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial049", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:09.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: Updating trial049:/etc/ceph/ceph.conf 2026-02-12T10:53:09.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:53:09.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: Updating trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:09.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:09.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:09.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.trial049", "caps": []}]: dispatch 2026-02-12T10:53:09.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.trial049", "caps": []}]': finished 2026-02-12T10:53:09.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:09 trial028 ceph-mon[21167]: mgrmap e13: a(active, since 6s) 2026-02-12T10:53:10.503 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial157' with addr '10.20.193.157' 2026-02-12T10:53:10.547 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-12T10:53:10.694 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:10.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: Updating trial049:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:10.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: Updating trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:53:10.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial157", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: Deploying daemon agent.trial049 on trial049 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: Deploying cephadm binary to trial157 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:10.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:10.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:10.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:10.895 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:10.895 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.49", "hostname": "trial049", "labels": [], "status": ""}, {"addr": "10.20.193.157", "hostname": "trial157", "labels": [], "status": ""}] 2026-02-12T10:53:10.941 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-12T10:53:10.942 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd crush tunables default 2026-02-12T10:53:11.090 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: Added host trial157 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial157", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.trial157", "caps": []}]: dispatch 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.trial157", "caps": []}]': finished 2026-02-12T10:53:11.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:11 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2283452093' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-12T10:53:12.287 INFO:teuthology.orchestra.run.trial028.stderr:adjusted tunables profile to default 2026-02-12T10:53:12.327 INFO:tasks.cephadm:Adding mon.a on trial028 2026-02-12T10:53:12.327 INFO:tasks.cephadm:Adding mon.b on trial049 2026-02-12T10:53:12.327 INFO:tasks.cephadm:Adding mon.c on trial157 2026-02-12T10:53:12.328 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch apply mon '3;trial028:10.20.193.28=a;trial049:10.20.193.49=b;trial157:10.20.193.157=c' 2026-02-12T10:53:12.479 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:12.695 INFO:teuthology.orchestra.run.trial157.stdout:Scheduled mon update... 2026-02-12T10:53:12.736 DEBUG:teuthology.orchestra.run.trial049:mon.b> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.b.service 2026-02-12T10:53:12.739 DEBUG:teuthology.orchestra.run.trial157:mon.c> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.c.service 2026-02-12T10:53:12.742 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-12T10:53:12.742 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: Updating trial157:/etc/ceph/ceph.conf 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: Updating trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: Updating trial157:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: Updating trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:12.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2283452093' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: osdmap e4: 0 total, 0 up, 0 in 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:12.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:13.032 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:13.285 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:53:13.286 INFO:teuthology.orchestra.run.trial157.stdout:{"epoch":1,"fsid":"edb480c7-0800-11f1-86ba-d404e6e7d460","modified":"2026-02-12T10:52:43.350494Z","created":"2026-02-12T10:52:43.350494Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-12T10:53:13.286 INFO:teuthology.orchestra.run.trial157.stderr:dumped monmap epoch 1 2026-02-12T10:53:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: Deploying daemon agent.trial157 on trial157 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:14.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:14.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:14.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:13 trial028 ceph-mon[21167]: from='client.? 10.20.193.157:0/1916398243' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:53:14.070 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:14 trial157 ceph-mon[22230]: mon.c@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2026-02-12T10:53:14.415 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-12T10:53:14.415 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:53:14.567 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.c/config 2026-02-12T10:53:19.192 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:53:19.192 INFO:teuthology.orchestra.run.trial157.stdout:{"epoch":2,"fsid":"edb480c7-0800-11f1-86ba-d404e6e7d460","modified":"2026-02-12T10:53:14.030205Z","created":"2026-02-12T10:52:43.350494Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:3300","nonce":0},{"type":"v1","addr":"10.20.193.157:6789","nonce":0}]},"addr":"10.20.193.157:6789/0","public_addr":"10.20.193.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-12T10:53:19.193 INFO:teuthology.orchestra.run.trial157.stderr:dumped monmap epoch 2 2026-02-12T10:53:19.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:53:19.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: mon.a calling monitor election 2026-02-12T10:53:19.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: mon.c calling monitor election 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: monmap epoch 2 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: last_changed 2026-02-12T10:53:14.030205+0000 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: min_mon_release 19 (squid) 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: election_strategy: 1 2026-02-12T10:53:19.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: 1: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: fsmap 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: osdmap e4: 0 total, 0 up, 0 in 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: mgrmap e13: a(active, since 16s) 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: overall HEALTH_OK 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:19.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:53:19.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: mon.a calling monitor election 2026-02-12T10:53:19.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: mon.c calling monitor election 2026-02-12T10:53:19.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: monmap epoch 2 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: last_changed 2026-02-12T10:53:14.030205+0000 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: min_mon_release 19 (squid) 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: election_strategy: 1 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: 1: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-12T10:53:19.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: fsmap 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: osdmap e4: 0 total, 0 up, 0 in 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: mgrmap e13: a(active, since 16s) 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: overall HEALTH_OK 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:19.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:20.243 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-12T10:53:20.244 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph mon dump -f json 2026-02-12T10:53:20.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:20 trial049 ceph-mon[22099]: mon.b@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2026-02-12T10:53:20.389 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.c/config 2026-02-12T10:53:20.412 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:20 trial157 ceph-mon[22230]: Deploying daemon mon.b on trial049 2026-02-12T10:53:20.412 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:20 trial157 ceph-mon[22230]: from='client.? 10.20.193.157:0/2886051787' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:53:20.412 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:20 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:20.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:20 trial028 ceph-mon[21167]: Deploying daemon mon.b on trial049 2026-02-12T10:53:20.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:20 trial028 ceph-mon[21167]: from='client.? 10.20.193.157:0/2886051787' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:53:20.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:20 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: mon.c calling monitor election 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: mon.a calling monitor election 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: mon.b calling monitor election 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: monmap epoch 3 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: last_changed 2026-02-12T10:53:20.208964+0000 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: min_mon_release 19 (squid) 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: election_strategy: 1 2026-02-12T10:53:25.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: 1: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: 2: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.b 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: fsmap 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: osdmap e4: 0 total, 0 up, 0 in 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: mgrmap e13: a(active, since 23s) 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: overall HEALTH_OK 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:25.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:25.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: mon.c calling monitor election 2026-02-12T10:53:25.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: mon.a calling monitor election 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: mon.b calling monitor election 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:25.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: monmap epoch 3 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: last_changed 2026-02-12T10:53:20.208964+0000 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: min_mon_release 19 (squid) 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: election_strategy: 1 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: 1: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: 2: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.b 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: fsmap 2026-02-12T10:53:25.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: osdmap e4: 0 total, 0 up, 0 in 2026-02-12T10:53:25.634 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: mgrmap e13: a(active, since 23s) 2026-02-12T10:53:25.634 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: overall HEALTH_OK 2026-02-12T10:53:25.634 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:25.634 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:25.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: mon.c calling monitor election 2026-02-12T10:53:25.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:53:25.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: mon.a calling monitor election 2026-02-12T10:53:25.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:53:25.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: mon.b calling monitor election 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: monmap epoch 3 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: last_changed 2026-02-12T10:53:20.208964+0000 2026-02-12T10:53:25.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: min_mon_release 19 (squid) 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: election_strategy: 1 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: 1: [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] mon.c 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: 2: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.b 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: fsmap 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: osdmap e4: 0 total, 0 up, 0 in 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: mgrmap e13: a(active, since 23s) 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: overall HEALTH_OK 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:25.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.415 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Updating trial028:/etc/ceph/ceph.conf 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Updating trial049:/etc/ceph/ceph.conf 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Updating trial157:/etc/ceph/ceph.conf 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Updating trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Updating trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Updating trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.416 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Reconfiguring mon.a (unknown last config time)... 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: Reconfiguring daemon mon.a on trial028 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.417 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:26.418 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.419 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:26 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:26.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Updating trial028:/etc/ceph/ceph.conf 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Updating trial049:/etc/ceph/ceph.conf 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Updating trial157:/etc/ceph/ceph.conf 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Updating trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Updating trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Updating trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Reconfiguring mon.a (unknown last config time)... 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: Reconfiguring daemon mon.a on trial028 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:26 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:26.541 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:26.541 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.541 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:26.541 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Updating trial028:/etc/ceph/ceph.conf 2026-02-12T10:53:26.541 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Updating trial049:/etc/ceph/ceph.conf 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Updating trial157:/etc/ceph/ceph.conf 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Updating trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Updating trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Updating trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Reconfiguring mon.a (unknown last config time)... 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: Reconfiguring daemon mon.a on trial028 2026-02-12T10:53:26.542 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:26.543 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:26 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:53:26.614 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:53:26.614 INFO:teuthology.orchestra.run.trial157.stdout:{"epoch":3,"fsid":"edb480c7-0800-11f1-86ba-d404e6e7d460","modified":"2026-02-12T10:53:20.208964Z","created":"2026-02-12T10:52:43.350494Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:3300","nonce":0},{"type":"v1","addr":"10.20.193.157:6789","nonce":0}]},"addr":"10.20.193.157:6789/0","public_addr":"10.20.193.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:3300","nonce":0},{"type":"v1","addr":"10.20.193.49:6789","nonce":0}]},"addr":"10.20.193.49:6789/0","public_addr":"10.20.193.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2026-02-12T10:53:26.614 INFO:teuthology.orchestra.run.trial157.stderr:dumped monmap epoch 3 2026-02-12T10:53:26.649 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-12T10:53:26.649 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-12T10:53:26.801 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:26.992 INFO:teuthology.orchestra.run.trial028.stdout:# minimal ceph.conf for edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:26.992 INFO:teuthology.orchestra.run.trial028.stdout:[global] 2026-02-12T10:53:26.992 INFO:teuthology.orchestra.run.trial028.stdout: fsid = edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:53:26.992 INFO:teuthology.orchestra.run.trial028.stdout: mon_host = [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] [v2:10.20.193.157:3300/0,v1:10.20.193.157:6789/0] 2026-02-12T10:53:27.031 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-12T10:53:27.031 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:53:27.031 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.conf 2026-02-12T10:53:27.058 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:53:27.058 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:27.124 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:53:27.124 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/ceph/ceph.conf 2026-02-12T10:53:27.153 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:53:27.153 DEBUG:teuthology.orchestra.run.trial049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:27.217 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:53:27.217 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/etc/ceph/ceph.conf 2026-02-12T10:53:27.246 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:53:27.246 DEBUG:teuthology.orchestra.run.trial157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:53:27.310 INFO:tasks.cephadm:Adding mgr.a on trial028 2026-02-12T10:53:27.310 INFO:tasks.cephadm:Adding mgr.b on trial049 2026-02-12T10:53:27.311 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch apply mgr '2;trial028=a;trial049=b' 2026-02-12T10:53:27.495 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.c/config 2026-02-12T10:53:27.516 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: Reconfiguring mon.b (monmap changed)... 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: Reconfiguring daemon mon.b on trial049 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:27.517 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: Reconfiguring mon.c (monmap changed)... 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: Reconfiguring daemon mon.c on trial157 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.518 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='client.? 10.20.193.157:0/77349061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.519 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:27 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3109798050' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: Reconfiguring mon.b (monmap changed)... 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: Reconfiguring daemon mon.b on trial049 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: Reconfiguring mon.c (monmap changed)... 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: Reconfiguring daemon mon.c on trial157 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='client.? 10.20.193.157:0/77349061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:27 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3109798050' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: Reconfiguring mon.b (monmap changed)... 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: Reconfiguring daemon mon.b on trial049 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: Reconfiguring mon.c (monmap changed)... 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: Reconfiguring daemon mon.c on trial157 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='client.? 10.20.193.157:0/77349061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-12T10:53:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:27 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3109798050' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:27.697 INFO:teuthology.orchestra.run.trial157.stdout:Scheduled mgr update... 2026-02-12T10:53:27.748 DEBUG:teuthology.orchestra.run.trial049:mgr.b> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.b.service 2026-02-12T10:53:27.749 INFO:tasks.cephadm:Deploying OSDs... 2026-02-12T10:53:27.749 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-12T10:53:27.749 DEBUG:teuthology.orchestra.run.trial028:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:53:27.765 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T10:53:27.765 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_1 2026-02-12T10:53:27.821 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T10:53:27.821 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:27.821 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1321 Links: 1 2026-02-12T10:53:27.822 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:27.822 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:27.822 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-12 10:53:26.540808899 +0000 2026-02-12T10:53:27.822 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-12 10:51:23.929899488 +0000 2026-02-12T10:53:27.822 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-12 10:51:23.929899488 +0000 2026-02-12T10:53:27.822 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-12 10:51:23.929899488 +0000 2026-02-12T10:53:27.822 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T10:53:27.885 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-12T10:53:27.885 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-12T10:53:27.885 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000171338 s, 3.0 MB/s 2026-02-12T10:53:27.886 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T10:53:27.942 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_2 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-12 10:53:26.540808899 +0000 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-12 10:51:23.928899505 +0000 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-12 10:51:23.928899505 +0000 2026-02-12T10:53:27.997 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-12 10:51:23.928899505 +0000 2026-02-12T10:53:27.998 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T10:53:28.060 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-12T10:53:28.060 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-12T10:53:28.060 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000154226 s, 3.3 MB/s 2026-02-12T10:53:28.061 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T10:53:28.118 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_3 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1317 Links: 1 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-12 10:53:26.540808899 +0000 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-12 10:51:23.929899488 +0000 2026-02-12T10:53:28.174 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-12 10:51:23.929899488 +0000 2026-02-12T10:53:28.175 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-12 10:51:23.929899488 +0000 2026-02-12T10:53:28.175 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T10:53:28.237 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-12T10:53:28.237 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-12T10:53:28.237 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000224928 s, 2.3 MB/s 2026-02-12T10:53:28.238 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T10:53:28.295 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_4 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-12 10:53:26.540808899 +0000 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-12 10:51:23.928899505 +0000 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-12 10:51:23.928899505 +0000 2026-02-12T10:53:28.351 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-12 10:51:23.928899505 +0000 2026-02-12T10:53:28.352 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T10:53:28.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mgr[23431]: -- 10.20.193.49:0/626265854 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b280514a0 con 0x558b2802f400 2026-02-12T10:53:28.415 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-12T10:53:28.415 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-12T10:53:28.415 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000238263 s, 2.1 MB/s 2026-02-12T10:53:28.416 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T10:53:28.474 DEBUG:teuthology.orchestra.run.trial049:> set -ex 2026-02-12T10:53:28.474 DEBUG:teuthology.orchestra.run.trial049:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:53:28.490 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T10:53:28.490 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_1 2026-02-12T10:53:28.546 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 10:53:28.141706089 +0000 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.547 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.547 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T10:53:28.611 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T10:53:28.611 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T10:53:28.611 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000157564 s, 3.2 MB/s 2026-02-12T10:53:28.612 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T10:53:28.669 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_2 2026-02-12T10:53:28.726 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T10:53:28.726 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:28.727 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-12T10:53:28.727 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:28.727 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:28.727 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 10:53:28.141706089 +0000 2026-02-12T10:53:28.727 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.727 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.727 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.727 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T10:53:28.789 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T10:53:28.789 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T10:53:28.789 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000171039 s, 3.0 MB/s 2026-02-12T10:53:28.790 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T10:53:28.848 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_3 2026-02-12T10:53:28.869 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:28.679+0000 7fed41f58140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-12T10:53:28.869 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:28.827+0000 7fed41f58140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:28.863+0000 7fed41f58140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;trial028=a;trial049=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: Saving service mgr spec with placement trial028=a;trial049=b;count:2 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-12T10:53:28.870 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: Deploying daemon mgr.b on trial049 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: Reconfiguring mgr.a (unknown last config time)... 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:53:28.871 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:28.872 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-mon[22099]: Reconfiguring daemon mgr.a on trial028 2026-02-12T10:53:28.888 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T10:53:28.888 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:28.888 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-12T10:53:28.889 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:28.889 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:28.889 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 10:53:28.142706076 +0000 2026-02-12T10:53:28.889 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.889 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.889 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:28.889 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T10:53:28.954 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T10:53:28.954 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T10:53:28.954 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.000157814 s, 3.2 MB/s 2026-02-12T10:53:28.955 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T10:53:29.012 DEBUG:teuthology.orchestra.run.trial049:> stat /dev/vg_nvme/lv_4 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;trial028=a;trial049=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: Saving service mgr spec with placement trial028=a;trial049=b;count:2 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: Deploying daemon mgr.b on trial049 2026-02-12T10:53:29.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: Reconfiguring mgr.a (unknown last config time)... 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:28 trial028 ceph-mon[21167]: Reconfiguring daemon mgr.a on trial028 2026-02-12T10:53:29.069 INFO:teuthology.orchestra.run.trial049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T10:53:29.069 INFO:teuthology.orchestra.run.trial049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:29.069 INFO:teuthology.orchestra.run.trial049.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-12T10:53:29.070 INFO:teuthology.orchestra.run.trial049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:29.070 INFO:teuthology.orchestra.run.trial049.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:29.070 INFO:teuthology.orchestra.run.trial049.stdout:Access: 2026-02-12 10:53:29.026693942 +0000 2026-02-12T10:53:29.070 INFO:teuthology.orchestra.run.trial049.stdout:Modify: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:29.070 INFO:teuthology.orchestra.run.trial049.stdout:Change: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:29.070 INFO:teuthology.orchestra.run.trial049.stdout: Birth: 2026-02-12 10:51:23.714907549 +0000 2026-02-12T10:53:29.070 DEBUG:teuthology.orchestra.run.trial049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:28.906+0000 7fed41f58140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:28.937+0000 7fed41f58140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:28 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:28.972+0000 7fed41f58140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.039+0000 7fed41f58140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: from numpy import show_config as show_numpy_config 2026-02-12T10:53:29.121 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.115+0000 7fed41f58140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-12T10:53:29.135 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records in 2026-02-12T10:53:29.135 INFO:teuthology.orchestra.run.trial049.stderr:1+0 records out 2026-02-12T10:53:29.135 INFO:teuthology.orchestra.run.trial049.stderr:512 bytes copied, 0.00015526 s, 3.3 MB/s 2026-02-12T10:53:29.136 DEBUG:teuthology.orchestra.run.trial049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T10:53:29.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;trial028=a;trial049=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: Saving service mgr spec with placement trial028=a;trial049=b;count:2 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: Deploying daemon mgr.b on trial049 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: Reconfiguring mgr.a (unknown last config time)... 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:28 trial157 ceph-mon[22230]: Reconfiguring daemon mgr.a on trial028 2026-02-12T10:53:29.194 DEBUG:teuthology.orchestra.run.trial157:> set -ex 2026-02-12T10:53:29.194 DEBUG:teuthology.orchestra.run.trial157:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T10:53:29.212 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T10:53:29.212 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_1 2026-02-12T10:53:29.268 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T10:53:29.268 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:29.269 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-12T10:53:29.269 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:29.269 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:29.269 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-12 10:53:26.259285747 +0000 2026-02-12T10:53:29.269 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.269 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.269 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.269 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T10:53:29.333 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-12T10:53:29.333 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-12T10:53:29.333 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.00015606 s, 3.3 MB/s 2026-02-12T10:53:29.334 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T10:53:29.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.150+0000 7fed41f58140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-12T10:53:29.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.249+0000 7fed41f58140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-12T10:53:29.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.309+0000 7fed41f58140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-12T10:53:29.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.345+0000 7fed41f58140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-12T10:53:29.391 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_2 2026-02-12T10:53:29.446 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-12 10:53:26.259285747 +0000 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.447 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.447 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T10:53:29.509 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-12T10:53:29.510 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-12T10:53:29.510 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.000139069 s, 3.7 MB/s 2026-02-12T10:53:29.511 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T10:53:29.568 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_3 2026-02-12T10:53:29.624 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T10:53:29.624 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:29.624 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-12T10:53:29.624 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:29.624 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:29.624 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-12 10:53:26.259285747 +0000 2026-02-12T10:53:29.624 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.625 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.625 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.625 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T10:53:29.685 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.377+0000 7fed41f58140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-12T10:53:29.686 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.411+0000 7fed41f58140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-12T10:53:29.686 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.441+0000 7fed41f58140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-12T10:53:29.687 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-12T10:53:29.687 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-12T10:53:29.687 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.000221903 s, 2.3 MB/s 2026-02-12T10:53:29.688 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T10:53:29.745 DEBUG:teuthology.orchestra.run.trial157:> stat /dev/vg_nvme/lv_4 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout:Access: 2026-02-12 10:53:26.259285747 +0000 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout:Modify: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout:Change: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.801 INFO:teuthology.orchestra.run.trial157.stdout: Birth: 2026-02-12 10:51:22.475280973 +0000 2026-02-12T10:53:29.802 DEBUG:teuthology.orchestra.run.trial157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T10:53:29.863 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records in 2026-02-12T10:53:29.863 INFO:teuthology.orchestra.run.trial157.stderr:1+0 records out 2026-02-12T10:53:29.863 INFO:teuthology.orchestra.run.trial157.stderr:512 bytes copied, 0.000213027 s, 2.4 MB/s 2026-02-12T10:53:29.864 DEBUG:teuthology.orchestra.run.trial157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T10:53:29.920 INFO:tasks.cephadm:Deploying osd.0 on trial028 with /dev/vg_nvme/lv_4... 2026-02-12T10:53:29.920 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.680+0000 7fed41f58140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.778+0000 7fed41f58140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.808+0000 7fed41f58140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.838+0000 7fed41f58140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.931+0000 7fed41f58140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:29.937 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:29.938 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.069 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:53:30.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.185 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:30.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:29 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:29.959+0000 7fed41f58140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-12T10:53:30.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:30 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:30.050+0000 7fed41f58140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-12T10:53:30.816 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:30.831 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_4 2026-02-12T10:53:30.881 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:30 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:30.507+0000 7fed41f58140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-12T10:53:30.881 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:30 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:30.536+0000 7fed41f58140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-12T10:53:30.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:30 trial049 ceph-mon[22099]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:30.982 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:31.004 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:30 trial028 ceph-mon[21167]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:31.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:30 trial157 ceph-mon[22230]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:31.381 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:53:30 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-b[23427]: 2026-02-12T10:53:30.928+0000 7fed41f58140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: Standby manager daemon b started 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:31.939 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:31 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: Standby manager daemon b started 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:32.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:31 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: Standby manager daemon b started 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='mgr.? 10.20.193.49:0/834051876' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:32.183 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:31 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: mgrmap e14: a(active, since 29s), standbys: b 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/4227069930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8769b737-0add-48cd-948f-fdfa27c33ef9"}]: dispatch 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/4227069930' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8769b737-0add-48cd-948f-fdfa27c33ef9"}]': finished 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: osdmap e5: 1 total, 0 up, 1 in 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/339179713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:32.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:32 trial028 ceph-mon[21167]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:33.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: mgrmap e14: a(active, since 29s), standbys: b 2026-02-12T10:53:33.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2026-02-12T10:53:33.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/4227069930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8769b737-0add-48cd-948f-fdfa27c33ef9"}]: dispatch 2026-02-12T10:53:33.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/4227069930' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8769b737-0add-48cd-948f-fdfa27c33ef9"}]': finished 2026-02-12T10:53:33.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: osdmap e5: 1 total, 0 up, 1 in 2026-02-12T10:53:33.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:33.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/339179713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:33.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:32 trial049 ceph-mon[22099]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: mgrmap e14: a(active, since 29s), standbys: b 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/4227069930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8769b737-0add-48cd-948f-fdfa27c33ef9"}]: dispatch 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/4227069930' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8769b737-0add-48cd-948f-fdfa27c33ef9"}]': finished 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: osdmap e5: 1 total, 0 up, 1 in 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/339179713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:33.184 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:32 trial157 ceph-mon[22230]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:35.366 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:35 trial028 ceph-mon[21167]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:35.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:35 trial049 ceph-mon[22099]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:35.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:35 trial157 ceph-mon[22230]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:36.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:36 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-12T10:53:36.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:36 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:36.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:36 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-12T10:53:36.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:36 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:36.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:36 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-12T10:53:36.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:36 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:37.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:37 trial028 ceph-mon[21167]: Deploying daemon osd.0 on trial028 2026-02-12T10:53:37.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:37 trial028 ceph-mon[21167]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:37.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:37 trial049 ceph-mon[22099]: Deploying daemon osd.0 on trial028 2026-02-12T10:53:37.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:37 trial049 ceph-mon[22099]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:37.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:37 trial157 ceph-mon[22230]: Deploying daemon osd.0 on trial028 2026-02-12T10:53:37.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:37 trial157 ceph-mon[22230]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:38.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:38 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:38.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:38 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:38 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:38.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:38 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:38.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:38 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:38 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.595 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 0 on host 'trial028' 2026-02-12T10:53:38.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:38 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:38.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:38 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:38 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:38.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:38 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:38.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:38 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:38 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.633 DEBUG:teuthology.orchestra.run.trial028:osd.0> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.0.service 2026-02-12T10:53:38.635 INFO:tasks.cephadm:Deploying osd.1 on trial028 with /dev/vg_nvme/lv_3... 2026-02-12T10:53:38.635 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-12T10:53:38.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:38 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:38.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:38 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:38 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:38.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:38 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:38.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:38 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:38 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:38.820 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: Adjusting osd_memory_target on trial028 to 83023M 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:39.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:39.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:39 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.497 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:53:39 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0[31242]: 2026-02-12T10:53:39.305+0000 7f563687c740 -1 Falling back to public interface 2026-02-12T10:53:39.563 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:53:39.579 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_3 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: Adjusting osd_memory_target on trial028 to 83023M 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:39.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:39 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: Adjusting osd_memory_target on trial028 to 83023M 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:39.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:39 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:39.728 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:53:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:40 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:40.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:40 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:40.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:40 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:40.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:40 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:40.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:40 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:40.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:40 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:40.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:40 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:40.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:40 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:40.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:40 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2885839955' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7dbe173-df96-416d-b658-444de2f6cee1"}]: dispatch 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2885839955' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7dbe173-df96-416d-b658-444de2f6cee1"}]': finished 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: osdmap e6: 2 total, 0 up, 2 in 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:41.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:41 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3958988813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:41.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:41.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:41.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/2885839955' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7dbe173-df96-416d-b658-444de2f6cee1"}]: dispatch 2026-02-12T10:53:41.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/2885839955' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7dbe173-df96-416d-b658-444de2f6cee1"}]': finished 2026-02-12T10:53:41.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: osdmap e6: 2 total, 0 up, 2 in 2026-02-12T10:53:41.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:41.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:41.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:41 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3958988813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/2885839955' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7dbe173-df96-416d-b658-444de2f6cee1"}]: dispatch 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/2885839955' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7dbe173-df96-416d-b658-444de2f6cee1"}]': finished 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: osdmap e6: 2 total, 0 up, 2 in 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:41.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:41 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3958988813' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:43.029 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:53:42 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0[31242]: 2026-02-12T10:53:42.582+0000 7f563687c740 -1 osd.0 0 log_to_monitors true 2026-02-12T10:53:43.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:43 trial028 ceph-mon[21167]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:43.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:43 trial028 ceph-mon[21167]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-12T10:53:43.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:43 trial049 ceph-mon[22099]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:43.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:43 trial049 ceph-mon[22099]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-12T10:53:43.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:43 trial157 ceph-mon[22230]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:43.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:43 trial157 ceph-mon[22230]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-12T10:53:44.395 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:53:44 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0[31242]: 2026-02-12T10:53:44.275+0000 7f56327fd640 -1 osd.0 0 waiting for initial osdmap 2026-02-12T10:53:44.395 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:53:44 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0[31242]: 2026-02-12T10:53:44.277+0000 7f562e627640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T10:53:44.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:44 trial028 ceph-mon[21167]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-12T10:53:44.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:44 trial028 ceph-mon[21167]: osdmap e7: 2 total, 0 up, 2 in 2026-02-12T10:53:44.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:44 trial028 ceph-mon[21167]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-12T10:53:44.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:44 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:44.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:44 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:44.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:44 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-12T10:53:44.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:44 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:44.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:44 trial049 ceph-mon[22099]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-12T10:53:44.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:44 trial049 ceph-mon[22099]: osdmap e7: 2 total, 0 up, 2 in 2026-02-12T10:53:44.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:44 trial049 ceph-mon[22099]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-12T10:53:44.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:44 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:44.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:44 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:44.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:44 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-12T10:53:44.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:44 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:44.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:44 trial157 ceph-mon[22230]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-12T10:53:44.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:44 trial157 ceph-mon[22230]: osdmap e7: 2 total, 0 up, 2 in 2026-02-12T10:53:44.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:44 trial157 ceph-mon[22230]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-12T10:53:44.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:44 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:44.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:44 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:44.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:44 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-12T10:53:44.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:44 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:45.550 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:45 trial157 ceph-mon[22230]: Deploying daemon osd.1 on trial028 2026-02-12T10:53:45.550 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:45 trial157 ceph-mon[22230]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:45.550 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:45 trial157 ceph-mon[22230]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-12T10:53:45.551 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:45 trial157 ceph-mon[22230]: osdmap e8: 2 total, 0 up, 2 in 2026-02-12T10:53:45.551 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:45 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:45.551 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:45 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:45.551 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:45 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:45.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:45 trial049 ceph-mon[22099]: Deploying daemon osd.1 on trial028 2026-02-12T10:53:45.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:45 trial049 ceph-mon[22099]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:45.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:45 trial049 ceph-mon[22099]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-12T10:53:45.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:45 trial049 ceph-mon[22099]: osdmap e8: 2 total, 0 up, 2 in 2026-02-12T10:53:45.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:45.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:45.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:45.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:45 trial028 ceph-mon[21167]: Deploying daemon osd.1 on trial028 2026-02-12T10:53:45.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:45 trial028 ceph-mon[21167]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:45.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:45 trial028 ceph-mon[21167]: from='osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-12T10:53:45.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:45 trial028 ceph-mon[21167]: osdmap e8: 2 total, 0 up, 2 in 2026-02-12T10:53:45.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:45.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:45.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:46.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: purged_snaps scrub starts 2026-02-12T10:53:46.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579] boot 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: osdmap e9: 2 total, 1 up, 2 in 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: purged_snaps scrub starts 2026-02-12T10:53:46.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:53:46.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579] boot 2026-02-12T10:53:46.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: osdmap e9: 2 total, 1 up, 2 in 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: purged_snaps scrub starts 2026-02-12T10:53:46.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: purged_snaps scrub ok 2026-02-12T10:53:46.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: osd.0 [v2:10.20.193.28:6802/3861244579,v1:10.20.193.28:6803/3861244579] boot 2026-02-12T10:53:46.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: osdmap e9: 2 total, 1 up, 2 in 2026-02-12T10:53:46.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-12T10:53:46.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:46.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:46.686 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:46 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.160 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 1 on host 'trial028' 2026-02-12T10:53:47.200 DEBUG:teuthology.orchestra.run.trial028:osd.1> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.1.service 2026-02-12T10:53:47.202 INFO:tasks.cephadm:Deploying osd.2 on trial049 with /dev/vg_nvme/lv_4... 2026-02-12T10:53:47.202 DEBUG:teuthology.orchestra.run.trial049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-12T10:53:47.351 INFO:teuthology.orchestra.run.trial049.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.b/config 2026-02-12T10:53:47.486 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.486 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.486 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.486 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.486 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:47.487 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.506 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.506 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.506 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:47.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:47.508 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.508 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.508 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:47.508 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:47.508 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:47.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:47 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:48.072 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:53:48.087 DEBUG:teuthology.orchestra.run.trial049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch daemon add osd trial049:vg_nvme/lv_4 2026-02-12T10:53:48.236 INFO:teuthology.orchestra.run.trial049.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.b/config 2026-02-12T10:53:48.335 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:53:48 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1[35002]: 2026-02-12T10:53:48.079+0000 7f32cfe1e740 -1 Falling back to public interface 2026-02-12T10:53:48.613 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:48 trial049 ceph-mon[22099]: Adjusting osd_memory_target on trial028 to 41511M 2026-02-12T10:53:48.614 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:48 trial049 ceph-mon[22099]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:48.614 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:48 trial049 ceph-mon[22099]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:48.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:48 trial157 ceph-mon[22230]: Adjusting osd_memory_target on trial028 to 41511M 2026-02-12T10:53:48.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:48 trial157 ceph-mon[22230]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:48.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:48 trial157 ceph-mon[22230]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:48.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:48 trial028 ceph-mon[21167]: Adjusting osd_memory_target on trial028 to 41511M 2026-02-12T10:53:48.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:48 trial028 ceph-mon[21167]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:48 trial028 ceph-mon[21167]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:49.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='client.? 10.20.193.49:0/3014462467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]: dispatch 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]: dispatch 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]': finished 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: osdmap e10: 3 total, 1 up, 3 in 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:49.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:49.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:49.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:49.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:49.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:49.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='client.? 10.20.193.49:0/3014462467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]: dispatch 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]: dispatch 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]': finished 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: osdmap e10: 3 total, 1 up, 3 in 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.681 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:49.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='client.? 10.20.193.49:0/3014462467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]: dispatch 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]: dispatch 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4756a99-c709-4a0e-8b00-51dd8560610a"}]': finished 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: osdmap e10: 3 total, 1 up, 3 in 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:49.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:49 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:50.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:50 trial049 ceph-mon[22099]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:50 trial049 ceph-mon[22099]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:50 trial049 ceph-mon[22099]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:50 trial049 ceph-mon[22099]: from='client.? 10.20.193.49:0/401386845' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:50.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:50 trial157 ceph-mon[22230]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:50 trial157 ceph-mon[22230]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:50 trial157 ceph-mon[22230]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:50 trial157 ceph-mon[22230]: from='client.? 10.20.193.49:0/401386845' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:50.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:50 trial028 ceph-mon[21167]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:50 trial028 ceph-mon[21167]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:50 trial028 ceph-mon[21167]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:50.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:50 trial028 ceph-mon[21167]: from='client.? 10.20.193.49:0/401386845' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:51.278 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:53:50 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1[35002]: 2026-02-12T10:53:50.820+0000 7f32cfe1e740 -1 osd.1 0 log_to_monitors true 2026-02-12T10:53:51.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:51 trial049 ceph-mon[22099]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-12T10:53:51.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:51 trial157 ceph-mon[22230]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-12T10:53:51.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:51 trial028 ceph-mon[21167]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-12T10:53:52.624 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:52 trial049 ceph-mon[22099]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:52.624 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:52 trial049 ceph-mon[22099]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-12T10:53:52.624 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:52 trial049 ceph-mon[22099]: osdmap e11: 3 total, 1 up, 3 in 2026-02-12T10:53:52.624 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:52 trial049 ceph-mon[22099]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-12T10:53:52.624 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:52 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:52.624 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:52 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:52.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:52 trial157 ceph-mon[22230]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:52.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:52 trial157 ceph-mon[22230]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-12T10:53:52.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:52 trial157 ceph-mon[22230]: osdmap e11: 3 total, 1 up, 3 in 2026-02-12T10:53:52.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:52 trial157 ceph-mon[22230]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-12T10:53:52.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:52 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:52.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:52 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:52.778 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:53:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1[35002]: 2026-02-12T10:53:52.498+0000 7f32cbd9f640 -1 osd.1 0 waiting for initial osdmap 2026-02-12T10:53:52.778 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:53:52 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1[35002]: 2026-02-12T10:53:52.499+0000 7f32c3bc1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T10:53:52.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:52 trial028 ceph-mon[21167]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:52.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:52 trial028 ceph-mon[21167]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-12T10:53:52.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:52 trial028 ceph-mon[21167]: osdmap e11: 3 total, 1 up, 3 in 2026-02-12T10:53:52.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:52 trial028 ceph-mon[21167]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-12T10:53:52.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:52 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:52.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:52 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:53.560 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:53 trial049 ceph-mon[22099]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-12T10:53:53.560 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:53 trial049 ceph-mon[22099]: osdmap e12: 3 total, 1 up, 3 in 2026-02-12T10:53:53.561 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:53.561 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:53.561 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:53.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:53 trial157 ceph-mon[22230]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-12T10:53:53.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:53 trial157 ceph-mon[22230]: osdmap e12: 3 total, 1 up, 3 in 2026-02-12T10:53:53.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:53 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:53.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:53 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:53.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:53 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:53.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:53 trial028 ceph-mon[21167]: from='osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-12T10:53:53.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:53 trial028 ceph-mon[21167]: osdmap e12: 3 total, 1 up, 3 in 2026-02-12T10:53:53.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:53.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:53.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: purged_snaps scrub starts 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: OSD bench result of 124243.604933 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175] boot 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: osdmap e13: 3 total, 2 up, 3 in 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:54.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:54 trial049 ceph-mon[22099]: Deploying daemon osd.2 on trial049 2026-02-12T10:53:54.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: purged_snaps scrub starts 2026-02-12T10:53:54.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: purged_snaps scrub ok 2026-02-12T10:53:54.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: OSD bench result of 124243.604933 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:53:54.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:54.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175] boot 2026-02-12T10:53:54.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: osdmap e13: 3 total, 2 up, 3 in 2026-02-12T10:53:54.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:54.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:54.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-12T10:53:54.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:54.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:54 trial157 ceph-mon[22230]: Deploying daemon osd.2 on trial049 2026-02-12T10:53:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: purged_snaps scrub starts 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: OSD bench result of 124243.604933 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: osd.1 [v2:10.20.193.28:6810/3980599175,v1:10.20.193.28:6811/3980599175] boot 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: osdmap e13: 3 total, 2 up, 3 in 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:54 trial028 ceph-mon[21167]: Deploying daemon osd.2 on trial049 2026-02-12T10:53:56.609 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:56 trial049 ceph-mon[22099]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:56.609 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:56.609 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.609 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:56.609 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:56.609 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.609 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.643 INFO:teuthology.orchestra.run.trial049.stdout:Created osd(s) 2 on host 'trial049' 2026-02-12T10:53:56.679 DEBUG:teuthology.orchestra.run.trial049:osd.2> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.2.service 2026-02-12T10:53:56.681 INFO:tasks.cephadm:Deploying osd.3 on trial049 with /dev/vg_nvme/lv_3... 2026-02-12T10:53:56.681 DEBUG:teuthology.orchestra.run.trial049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-12T10:53:56.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:56 trial157 ceph-mon[22230]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:56.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:56 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:56.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:56 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:56 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:56.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:56 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:56.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:56 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:56 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:56 trial028 ceph-mon[21167]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:56.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:56.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:56.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:56.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:56.866 INFO:teuthology.orchestra.run.trial049.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.b/config 2026-02-12T10:53:57.530 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:57.531 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:57.532 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:57 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.597 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T10:53:57.613 DEBUG:teuthology.orchestra.run.trial049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch daemon add osd trial049:vg_nvme/lv_3 2026-02-12T10:53:57.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:57.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:57 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.765 INFO:teuthology.orchestra.run.trial049.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.b/config 2026-02-12T10:53:57.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:53:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:57 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:53:57.788 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:53:57 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2[27120]: 2026-02-12T10:53:57.624+0000 7f743706f740 -1 Falling back to public interface 2026-02-12T10:53:58.457 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:58 trial049 ceph-mon[22099]: Adjusting osd_memory_target on trial049 to 83023M 2026-02-12T10:53:58.457 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:58 trial049 ceph-mon[22099]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:58.457 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:58 trial049 ceph-mon[22099]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:58.457 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:58 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:58.457 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:58 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:58.458 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:58 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:58.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:58 trial157 ceph-mon[22230]: Adjusting osd_memory_target on trial049 to 83023M 2026-02-12T10:53:58.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:58 trial157 ceph-mon[22230]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:58.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:58 trial157 ceph-mon[22230]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:58.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:58 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:58.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:58 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:58.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:58 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:58.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:58 trial028 ceph-mon[21167]: Adjusting osd_memory_target on trial049 to 83023M 2026-02-12T10:53:58.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:58 trial028 ceph-mon[21167]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:58.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:58 trial028 ceph-mon[21167]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:53:58.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:58 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:53:58.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:58 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:53:58.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:58 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:53:59.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:59.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: from='client.? 10.20.193.49:0/2843483487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]: dispatch 2026-02-12T10:53:59.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]: dispatch 2026-02-12T10:53:59.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]': finished 2026-02-12T10:53:59.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: osdmap e14: 4 total, 2 up, 4 in 2026-02-12T10:53:59.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:59.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:53:59.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:53:59 trial049 ceph-mon[22099]: from='client.? 10.20.193.49:0/884454702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:59.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:59.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: from='client.? 10.20.193.49:0/2843483487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]: dispatch 2026-02-12T10:53:59.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]: dispatch 2026-02-12T10:53:59.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]': finished 2026-02-12T10:53:59.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: osdmap e14: 4 total, 2 up, 4 in 2026-02-12T10:53:59.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:59.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:53:59.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:53:59 trial157 ceph-mon[22230]: from='client.? 10.20.193.49:0/884454702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:53:59.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: from='client.24170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:53:59.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: from='client.? 10.20.193.49:0/2843483487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]: dispatch 2026-02-12T10:53:59.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]: dispatch 2026-02-12T10:53:59.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0663ad8-4255-4201-8641-f02cd1665fae"}]': finished 2026-02-12T10:53:59.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: osdmap e14: 4 total, 2 up, 4 in 2026-02-12T10:53:59.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:53:59.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:53:59.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:53:59 trial028 ceph-mon[21167]: from='client.? 10.20.193.49:0/884454702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:54:00.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:00 trial049 ceph-mon[22099]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:00.881 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:00 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2[27120]: 2026-02-12T10:54:00.641+0000 7f743706f740 -1 osd.2 0 log_to_monitors true 2026-02-12T10:54:00.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:00 trial157 ceph-mon[22230]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:01.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:00 trial028 ceph-mon[21167]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:01.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:01 trial049 ceph-mon[22099]: from='osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T10:54:01.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:01 trial049 ceph-mon[22099]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T10:54:01.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:01 trial157 ceph-mon[22230]: from='osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T10:54:01.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:01 trial157 ceph-mon[22230]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T10:54:02.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:01 trial028 ceph-mon[21167]: from='osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T10:54:02.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:01 trial028 ceph-mon[21167]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-12T10:54:02.658 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:02 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2[27120]: 2026-02-12T10:54:02.620+0000 7f7432ff0640 -1 osd.2 0 waiting for initial osdmap 2026-02-12T10:54:02.658 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:02 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2[27120]: 2026-02-12T10:54:02.623+0000 7f742ee1a640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: osdmap e15: 4 total, 2 up, 4 in 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: from='osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-12T10:54:02.658 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:02 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: osdmap e15: 4 total, 2 up, 4 in 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: from='osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-12T10:54:02.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:02 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: osdmap e15: 4 total, 2 up, 4 in 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: from='osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-12T10:54:03.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:02 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:03.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:03 trial049 ceph-mon[22099]: Deploying daemon osd.3 on trial049 2026-02-12T10:54:03.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:03 trial049 ceph-mon[22099]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]': finished 2026-02-12T10:54:03.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:03 trial049 ceph-mon[22099]: osdmap e16: 4 total, 2 up, 4 in 2026-02-12T10:54:03.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:03 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:03.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:03 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:03.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:03 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:03.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:03 trial157 ceph-mon[22230]: Deploying daemon osd.3 on trial049 2026-02-12T10:54:03.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:03 trial157 ceph-mon[22230]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]': finished 2026-02-12T10:54:03.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:03 trial157 ceph-mon[22230]: osdmap e16: 4 total, 2 up, 4 in 2026-02-12T10:54:03.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:03 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:03.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:03 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:03.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:03 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:04.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:03 trial028 ceph-mon[21167]: Deploying daemon osd.3 on trial049 2026-02-12T10:54:04.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:03 trial028 ceph-mon[21167]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial049", "root=default"]}]': finished 2026-02-12T10:54:04.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:03 trial028 ceph-mon[21167]: osdmap e16: 4 total, 2 up, 4 in 2026-02-12T10:54:04.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:04.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:04.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:03 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:04.838 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: purged_snaps scrub starts 2026-02-12T10:54:04.838 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:54:04.839 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:04.839 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:04.839 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384] boot 2026-02-12T10:54:04.839 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: osdmap e17: 4 total, 3 up, 4 in 2026-02-12T10:54:04.839 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:04.839 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:04.839 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:04 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: purged_snaps scrub starts 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: purged_snaps scrub ok 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384] boot 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: osdmap e17: 4 total, 3 up, 4 in 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:04.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:04 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: purged_snaps scrub starts 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: osd.2 [v2:10.20.193.49:6800/163238384,v1:10.20.193.49:6801/163238384] boot 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: osdmap e17: 4 total, 3 up, 4 in 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:05.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:04 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:05.584 INFO:teuthology.orchestra.run.trial049.stdout:Created osd(s) 3 on host 'trial049' 2026-02-12T10:54:05.621 DEBUG:teuthology.orchestra.run.trial049:osd.3> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.3.service 2026-02-12T10:54:05.622 INFO:tasks.cephadm:Deploying osd.4 on trial157 with /dev/vg_nvme/lv_4... 2026-02-12T10:54:05.622 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-12T10:54:05.775 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.c/config 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: osdmap e18: 4 total, 3 up, 4 in 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:05.802 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: osdmap e18: 4 total, 3 up, 4 in 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:05.889 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36165]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36165]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36165]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36169]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36169]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.028 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36169]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36173]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36177]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36177]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.029 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36177]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: osdmap e18: 4 total, 3 up, 4 in 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36181]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36181]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36181]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36185]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36185]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:05 trial028 sudo[36185]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30929]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-12T10:54:06.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30929]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30929]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30933]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-12T10:54:06.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30933]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.132 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30921]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-12T10:54:06.132 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30921]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.132 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.132 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30921]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.132 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30925]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-12T10:54:06.132 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30925]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.132 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.133 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:54:05 trial049 sudo[30925]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24777]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24777]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24777]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24792]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24792]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-12T10:54:06.166 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:05 trial157 sudo[24792]: pam_unix(sudo:session): session closed for user root 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: pgmap v51: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: pgmap v52: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: pgmap v53: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: Adjusting osd_memory_target on trial049 to 41511M 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: pgmap v54: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: pgmap v55: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: osdmap e19: 4 total, 3 up, 4 in 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:06.792 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.793 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:06 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.880 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:54:06 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3[30482]: 2026-02-12T10:54:06.512+0000 7f321a24b740 -1 Falling back to public interface 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: pgmap v51: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: pgmap v52: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: pgmap v53: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: Adjusting osd_memory_target on trial049 to 41511M 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: pgmap v54: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: pgmap v55: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: osdmap e19: 4 total, 3 up, 4 in 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:06 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:06.893 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:54:06.909 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch daemon add osd trial157:vg_nvme/lv_4 2026-02-12T10:54:07.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: pgmap v51: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: pgmap v52: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: pgmap v53: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: Adjusting osd_memory_target on trial049 to 41511M 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: pgmap v54: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: pgmap v55: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: osdmap e19: 4 total, 3 up, 4 in 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:06 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.057 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.c/config 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: pgmap v57: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: Detected new or changed devices on trial028 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: osdmap e20: 4 total, 3 up, 4 in 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: mgrmap e15: a(active, since 64s), standbys: b 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-12T10:54:07.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:07 trial157 ceph-mon[22230]: Cluster is now healthy 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: pgmap v57: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: Detected new or changed devices on trial028 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: osdmap e20: 4 total, 3 up, 4 in 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:07.918 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:07.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: mgrmap e15: a(active, since 64s), standbys: b 2026-02-12T10:54:07.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:54:07.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:54:07.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:07.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2026-02-12T10:54:07.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-12T10:54:07.919 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:07 trial028 ceph-mon[21167]: Cluster is now healthy 2026-02-12T10:54:08.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: pgmap v57: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:08.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:08.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: Detected new or changed devices on trial028 2026-02-12T10:54:08.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: pgmap v59: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:08.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:08.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: osdmap e20: 4 total, 3 up, 4 in 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: mgrmap e15: a(active, since 64s), standbys: b 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:54:08.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:08.133 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2026-02-12T10:54:08.133 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-12T10:54:08.133 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:07 trial049 ceph-mon[22099]: Cluster is now healthy 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: from='client.? 10.20.193.157:0/1537511829' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]: dispatch 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]: dispatch 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]': finished 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: osdmap e21: 5 total, 3 up, 5 in 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:08.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:08.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:08 trial157 ceph-mon[22230]: from='client.? 10.20.193.157:0/3835132960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: from='client.? 10.20.193.157:0/1537511829' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]: dispatch 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]: dispatch 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]': finished 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: osdmap e21: 5 total, 3 up, 5 in 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:09.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:09.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:08 trial028 ceph-mon[21167]: from='client.? 10.20.193.157:0/3835132960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:54:09.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: pgmap v62: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:09.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:09.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: from='client.? 10.20.193.157:0/1537511829' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]: dispatch 2026-02-12T10:54:09.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]: dispatch 2026-02-12T10:54:09.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17"}]': finished 2026-02-12T10:54:09.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: osdmap e21: 5 total, 3 up, 5 in 2026-02-12T10:54:09.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:09.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:09.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:08 trial049 ceph-mon[22099]: from='client.? 10.20.193.157:0/3835132960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:54:09.518 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:54:09 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3[30482]: 2026-02-12T10:54:09.246+0000 7f321a24b740 -1 osd.3 0 log_to_monitors true 2026-02-12T10:54:09.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: pgmap v64: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:09.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T10:54:09.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T10:54:09.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:09.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:09.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: Detected new or changed devices on trial049 2026-02-12T10:54:09.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:09.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:09.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:09.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:09.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:09 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: pgmap v64: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: Detected new or changed devices on trial049 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:09.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:09.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:09.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:09 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: pgmap v64: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: Detected new or changed devices on trial049 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:10.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:10.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:09 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-12T10:54:10.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:10.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: osdmap e22: 5 total, 3 up, 5 in 2026-02-12T10:54:10.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:10.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:10.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:10 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: osdmap e22: 5 total, 3 up, 5 in 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:11.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:11.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:11.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:10 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.131 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:54:10 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3[30482]: 2026-02-12T10:54:10.799+0000 7f32161cc640 -1 osd.3 0 waiting for initial osdmap 2026-02-12T10:54:11.131 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:54:10 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3[30482]: 2026-02-12T10:54:10.800+0000 7f320dfee640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T10:54:11.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: osdmap e22: 5 total, 3 up, 5 in 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]: dispatch 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:11.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:11.133 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:10 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:11.817 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]': finished 2026-02-12T10:54:11.817 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: osdmap e23: 5 total, 3 up, 5 in 2026-02-12T10:54:11.817 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:11.817 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:11.817 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:11.817 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:11.817 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-12T10:54:11.818 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:11.818 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: Deploying daemon osd.4 on trial157 2026-02-12T10:54:11.818 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430] boot 2026-02-12T10:54:11.818 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: osdmap e24: 5 total, 4 up, 5 in 2026-02-12T10:54:11.818 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:11.818 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:11 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]': finished 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: osdmap e23: 5 total, 3 up, 5 in 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:12.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: Deploying daemon osd.4 on trial157 2026-02-12T10:54:12.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430] boot 2026-02-12T10:54:12.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: osdmap e24: 5 total, 4 up, 5 in 2026-02-12T10:54:12.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:12.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:12.107 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial049", "root=default"]}]': finished 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: osdmap e23: 5 total, 3 up, 5 in 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: Deploying daemon osd.4 on trial157 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: osd.3 [v2:10.20.193.49:6808/3168734430,v1:10.20.193.49:6809/3168734430] boot 2026-02-12T10:54:12.108 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: osdmap e24: 5 total, 4 up, 5 in 2026-02-12T10:54:12.109 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-12T10:54:12.109 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:12.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:12 trial049 ceph-mon[22099]: purged_snaps scrub starts 2026-02-12T10:54:12.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:12 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:54:12.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:12 trial049 ceph-mon[22099]: OSD bench result of 115897.045255 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:12.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:12 trial049 ceph-mon[22099]: osdmap e25: 5 total, 4 up, 5 in 2026-02-12T10:54:12.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:12 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:12.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:12 trial157 ceph-mon[22230]: purged_snaps scrub starts 2026-02-12T10:54:12.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:12 trial157 ceph-mon[22230]: purged_snaps scrub ok 2026-02-12T10:54:12.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:12 trial157 ceph-mon[22230]: OSD bench result of 115897.045255 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:12.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:12 trial157 ceph-mon[22230]: osdmap e25: 5 total, 4 up, 5 in 2026-02-12T10:54:12.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:12 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:13.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:12 trial028 ceph-mon[21167]: purged_snaps scrub starts 2026-02-12T10:54:13.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:12 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:54:13.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:12 trial028 ceph-mon[21167]: OSD bench result of 115897.045255 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:13.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:12 trial028 ceph-mon[21167]: osdmap e25: 5 total, 4 up, 5 in 2026-02-12T10:54:13.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: pgmap v70: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: osdmap e26: 5 total, 4 up, 5 in 2026-02-12T10:54:13.683 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:13 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: pgmap v70: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: osdmap e26: 5 total, 4 up, 5 in 2026-02-12T10:54:14.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: pgmap v70: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: osdmap e26: 5 total, 4 up, 5 in 2026-02-12T10:54:14.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:14.603 INFO:teuthology.orchestra.run.trial157.stdout:Created osd(s) 4 on host 'trial157' 2026-02-12T10:54:14.643 DEBUG:teuthology.orchestra.run.trial157:osd.4> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.4.service 2026-02-12T10:54:14.644 INFO:tasks.cephadm:Deploying osd.5 on trial157 with /dev/vg_nvme/lv_3... 2026-02-12T10:54:14.644 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-12T10:54:14.828 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.c/config 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: Adjusting osd_memory_target on trial157 to 87119M 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:14.849 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:14 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: Adjusting osd_memory_target on trial157 to 87119M 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:15.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.130 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:15.130 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:15.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: Adjusting osd_memory_target on trial157 to 87119M 2026-02-12T10:54:15.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:15.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:15.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:15.559 INFO:teuthology.orchestra.run.trial157.stdout: 2026-02-12T10:54:15.576 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph orch daemon add osd trial157:vg_nvme/lv_3 2026-02-12T10:54:15.723 INFO:teuthology.orchestra.run.trial157.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.c/config 2026-02-12T10:54:15.767 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:15 trial157 ceph-mon[22230]: pgmap v72: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:54:15.767 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:15 trial157 ceph-mon[22230]: osdmap e27: 5 total, 4 up, 5 in 2026-02-12T10:54:15.767 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:15 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:15.767 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:15 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4[27337]: 2026-02-12T10:54:15.541+0000 7f07e4362740 -1 Falling back to public interface 2026-02-12T10:54:16.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:15 trial028 ceph-mon[21167]: pgmap v72: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:54:16.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:15 trial028 ceph-mon[21167]: osdmap e27: 5 total, 4 up, 5 in 2026-02-12T10:54:16.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:15 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:16.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:15 trial049 ceph-mon[22099]: pgmap v72: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:54:16.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:15 trial049 ceph-mon[22099]: osdmap e27: 5 total, 4 up, 5 in 2026-02-12T10:54:16.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:15 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:16.721 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: osdmap e28: 5 total, 4 up, 5 in 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='client.? 10.20.193.157:0/259885014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]': finished 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: osdmap e29: 6 total, 4 up, 6 in 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:16.722 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:16 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:17.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: osdmap e28: 5 total, 4 up, 5 in 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='client.? 10.20.193.157:0/259885014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]: dispatch 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]: dispatch 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]': finished 2026-02-12T10:54:17.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: osdmap e29: 6 total, 4 up, 6 in 2026-02-12T10:54:17.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:17.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:17.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: osdmap e28: 5 total, 4 up, 5 in 2026-02-12T10:54:17.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:17.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:17.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-12T10:54:17.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-12T10:54:17.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:17.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='client.? 10.20.193.157:0/259885014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]: dispatch 2026-02-12T10:54:17.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]: dispatch 2026-02-12T10:54:17.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38584f1f-b59a-4a51-a52d-b3ffc0ce9f09"}]': finished 2026-02-12T10:54:17.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: osdmap e29: 6 total, 4 up, 6 in 2026-02-12T10:54:17.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:17.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:17.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:17 trial157 ceph-mon[22230]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-12T10:54:17.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:17 trial157 ceph-mon[22230]: from='client.? 10.20.193.157:0/358510665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:54:18.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:17 trial028 ceph-mon[21167]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-12T10:54:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:17 trial028 ceph-mon[21167]: from='client.? 10.20.193.157:0/358510665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:54:18.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:17 trial049 ceph-mon[22099]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-12T10:54:18.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:17 trial049 ceph-mon[22099]: from='client.? 10.20.193.157:0/358510665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-12T10:54:18.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:18 trial157 ceph-mon[22230]: from='osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T10:54:18.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:18 trial157 ceph-mon[22230]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T10:54:18.934 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:18 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4[27337]: 2026-02-12T10:54:18.592+0000 7f07e4362740 -1 osd.4 0 log_to_monitors true 2026-02-12T10:54:19.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:18 trial028 ceph-mon[21167]: from='osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T10:54:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:18 trial028 ceph-mon[21167]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T10:54:19.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:18 trial049 ceph-mon[22099]: from='osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T10:54:19.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:18 trial049 ceph-mon[22099]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-12T10:54:19.930 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:19 trial028 ceph-mon[21167]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 115 KiB/s, 0 objects/s recovering 2026-02-12T10:54:19.930 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:19 trial028 ceph-mon[21167]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-12T10:54:19.930 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:19 trial028 ceph-mon[21167]: from='osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:19.930 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:19 trial028 ceph-mon[21167]: osdmap e30: 6 total, 4 up, 6 in 2026-02-12T10:54:19.930 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:19.930 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:19 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:19.931 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:19 trial028 ceph-mon[21167]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:19.934 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:19 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4[27337]: 2026-02-12T10:54:19.811+0000 7f07e02e3640 -1 osd.4 0 waiting for initial osdmap 2026-02-12T10:54:19.934 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:19 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4[27337]: 2026-02-12T10:54:19.813+0000 7f07d8105640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T10:54:19.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:19 trial157 ceph-mon[22230]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 115 KiB/s, 0 objects/s recovering 2026-02-12T10:54:19.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:19 trial157 ceph-mon[22230]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-12T10:54:19.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:19 trial157 ceph-mon[22230]: from='osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:19.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:19 trial157 ceph-mon[22230]: osdmap e30: 6 total, 4 up, 6 in 2026-02-12T10:54:19.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:19.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:19 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:19.935 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:19 trial157 ceph-mon[22230]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:20.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:19 trial049 ceph-mon[22099]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 115 KiB/s, 0 objects/s recovering 2026-02-12T10:54:20.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:19 trial049 ceph-mon[22099]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-12T10:54:20.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:19 trial049 ceph-mon[22099]: from='osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:20.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:19 trial049 ceph-mon[22099]: osdmap e30: 6 total, 4 up, 6 in 2026-02-12T10:54:20.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:19 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:20.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:19 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:20.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:19 trial049 ceph-mon[22099]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:20.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]': finished 2026-02-12T10:54:20.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: osdmap e31: 6 total, 4 up, 6 in 2026-02-12T10:54:20.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:20.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:20.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:20.684 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599] boot 2026-02-12T10:54:20.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: osdmap e32: 6 total, 5 up, 6 in 2026-02-12T10:54:20.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:20.685 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:20 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:21.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]': finished 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: osdmap e31: 6 total, 4 up, 6 in 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599] boot 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: osdmap e32: 6 total, 5 up, 6 in 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:21.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:20 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:21.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial157", "root=default"]}]': finished 2026-02-12T10:54:21.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: osdmap e31: 6 total, 4 up, 6 in 2026-02-12T10:54:21.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:21.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:21.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:21.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: osd.4 [v2:10.20.193.157:6800/2322913599,v1:10.20.193.157:6801/2322913599] boot 2026-02-12T10:54:21.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: osdmap e32: 6 total, 5 up, 6 in 2026-02-12T10:54:21.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-12T10:54:21.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:20 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: purged_snaps scrub starts 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: purged_snaps scrub ok 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: OSD bench result of 126688.707686 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 143 KiB/s, 0 objects/s recovering 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: Deploying daemon osd.5 on trial157 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: osdmap e33: 6 total, 5 up, 6 in 2026-02-12T10:54:21.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:21 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:22.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: purged_snaps scrub starts 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: OSD bench result of 126688.707686 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 143 KiB/s, 0 objects/s recovering 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: Deploying daemon osd.5 on trial157 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: osdmap e33: 6 total, 5 up, 6 in 2026-02-12T10:54:22.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:21 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:22.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: purged_snaps scrub starts 2026-02-12T10:54:22.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:54:22.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: OSD bench result of 126688.707686 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:22.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 143 KiB/s, 0 objects/s recovering 2026-02-12T10:54:22.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-12T10:54:22.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:22.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: Deploying daemon osd.5 on trial157 2026-02-12T10:54:22.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: osdmap e33: 6 total, 5 up, 6 in 2026-02-12T10:54:22.132 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:21 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:23.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: osdmap e34: 6 total, 5 up, 6 in 2026-02-12T10:54:23.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:23.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:23.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:23.383 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:23.383 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.383 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:23 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: osdmap e34: 6 total, 5 up, 6 in 2026-02-12T10:54:23.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:23.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:23.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:23.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:23.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:23 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: osdmap e34: 6 total, 5 up, 6 in 2026-02-12T10:54:23.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:23.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:23.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:23.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:23.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:23 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:23.619 INFO:teuthology.orchestra.run.trial157.stdout:Created osd(s) 5 on host 'trial157' 2026-02-12T10:54:23.657 DEBUG:teuthology.orchestra.run.trial157:osd.5> sudo journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.5.service 2026-02-12T10:54:23.658 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2026-02-12T10:54:23.658 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:54:23.812 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:24.008 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:24.046 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1770893660,"num_in_osds":6,"osd_in_since":1770893656,"num_remapped_pgs":0} 2026-02-12T10:54:24.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:24.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: osdmap e35: 6 total, 5 up, 6 in 2026-02-12T10:54:24.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:24.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:24.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:24.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:24.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: Adjusting osd_memory_target on trial157 to 43559M 2026-02-12T10:54:24.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:24.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:24.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:24 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/4122610203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: osdmap e35: 6 total, 5 up, 6 in 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:24.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: Adjusting osd_memory_target on trial157 to 43559M 2026-02-12T10:54:24.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:24.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:24.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.382 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:24 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/4122610203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:24.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: osdmap e35: 6 total, 5 up, 6 in 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: Adjusting osd_memory_target on trial157 to 43559M 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:24.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:24.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:24.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:24 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/4122610203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:24.933 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:54:24 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5[30787]: 2026-02-12T10:54:24.525+0000 7f38ccff7740 -1 Falling back to public interface 2026-02-12T10:54:25.048 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:54:25.204 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:25.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:25 trial049 ceph-mon[22099]: osdmap e36: 6 total, 5 up, 6 in 2026-02-12T10:54:25.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:25 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:25.399 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:25.400 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:25 trial028 ceph-mon[21167]: osdmap e36: 6 total, 5 up, 6 in 2026-02-12T10:54:25.400 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:25 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:25.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:25 trial157 ceph-mon[22230]: osdmap e36: 6 total, 5 up, 6 in 2026-02-12T10:54:25.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:25 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:25.435 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1770893660,"num_in_osds":6,"osd_in_since":1770893656,"num_remapped_pgs":0} 2026-02-12T10:54:26.389 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:26 trial157 ceph-mon[22230]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:26.389 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:26 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/568610818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:26.437 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:54:26.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:26 trial028 ceph-mon[21167]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:26.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:26 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/568610818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:26.591 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:26.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:26 trial049 ceph-mon[22099]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:26.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:26 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/568610818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:26.795 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:26.834 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1770893660,"num_in_osds":6,"osd_in_since":1770893656,"num_remapped_pgs":0} 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: osdmap e37: 6 total, 5 up, 6 in 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:27.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3813074073' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.436 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:27 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: osdmap e37: 6 total, 5 up, 6 in 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:27.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3813074073' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:27 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: osdmap e37: 6 total, 5 up, 6 in 2026-02-12T10:54:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3813074073' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:27.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.633 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:27 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:27.835 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:54:27.934 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:54:27 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5[30787]: 2026-02-12T10:54:27.521+0000 7f38ccff7740 -1 osd.5 0 log_to_monitors true 2026-02-12T10:54:28.025 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:28.223 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:28.260 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1770893660,"num_in_osds":6,"osd_in_since":1770893656,"num_remapped_pgs":0} 2026-02-12T10:54:28.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:28 trial028 ceph-mon[21167]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 127 KiB/s, 0 objects/s recovering 2026-02-12T10:54:28.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:28 trial028 ceph-mon[21167]: Detected new or changed devices on trial157 2026-02-12T10:54:28.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:28 trial028 ceph-mon[21167]: osdmap e38: 6 total, 5 up, 6 in 2026-02-12T10:54:28.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:28.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:28 trial028 ceph-mon[21167]: from='osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T10:54:28.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:28 trial028 ceph-mon[21167]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T10:54:28.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:28 trial157 ceph-mon[22230]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 127 KiB/s, 0 objects/s recovering 2026-02-12T10:54:28.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:28 trial157 ceph-mon[22230]: Detected new or changed devices on trial157 2026-02-12T10:54:28.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:28 trial157 ceph-mon[22230]: osdmap e38: 6 total, 5 up, 6 in 2026-02-12T10:54:28.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:28 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:28.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:28 trial157 ceph-mon[22230]: from='osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T10:54:28.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:28 trial157 ceph-mon[22230]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T10:54:28.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:28 trial049 ceph-mon[22099]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 127 KiB/s, 0 objects/s recovering 2026-02-12T10:54:28.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:28 trial049 ceph-mon[22099]: Detected new or changed devices on trial157 2026-02-12T10:54:28.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:28 trial049 ceph-mon[22099]: osdmap e38: 6 total, 5 up, 6 in 2026-02-12T10:54:28.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:28.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:28 trial049 ceph-mon[22099]: from='osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T10:54:28.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:28 trial049 ceph-mon[22099]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-12T10:54:29.261 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:54:29.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:29 trial028 ceph-mon[21167]: from='osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:29.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:29 trial028 ceph-mon[21167]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-12T10:54:29.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:29 trial028 ceph-mon[21167]: osdmap e39: 6 total, 5 up, 6 in 2026-02-12T10:54:29.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:29 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:29.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:29 trial028 ceph-mon[21167]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:29.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:29 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/437227345' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:29.414 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:29.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:29 trial157 ceph-mon[22230]: from='osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:29.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:29 trial157 ceph-mon[22230]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-12T10:54:29.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:29 trial157 ceph-mon[22230]: osdmap e39: 6 total, 5 up, 6 in 2026-02-12T10:54:29.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:29 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:29.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:29 trial157 ceph-mon[22230]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:29.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:29 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/437227345' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:29.434 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:54:29 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5[30787]: 2026-02-12T10:54:29.140+0000 7f38c8f78640 -1 osd.5 0 waiting for initial osdmap 2026-02-12T10:54:29.434 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:54:29 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5[30787]: 2026-02-12T10:54:29.143+0000 7f38c4da2640 -1 osd.5 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T10:54:29.607 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:29.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:29 trial049 ceph-mon[22099]: from='osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:29.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:29 trial049 ceph-mon[22099]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-12T10:54:29.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:29 trial049 ceph-mon[22099]: osdmap e39: 6 total, 5 up, 6 in 2026-02-12T10:54:29.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:29 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:29.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:29 trial049 ceph-mon[22099]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]: dispatch 2026-02-12T10:54:29.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:29 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/437227345' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:29.645 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":40,"num_osds":6,"num_up_osds":5,"osd_up_since":1770893660,"num_in_osds":6,"osd_in_since":1770893656,"num_remapped_pgs":0} 2026-02-12T10:54:30.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 127 KiB/s, 0 objects/s recovering 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]': finished 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: osdmap e40: 6 total, 5 up, 6 in 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/994010142' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997] boot 2026-02-12T10:54:30.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: osdmap e41: 6 total, 6 up, 6 in 2026-02-12T10:54:30.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:30 trial157 ceph-mon[22230]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 127 KiB/s, 0 objects/s recovering 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]': finished 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: osdmap e40: 6 total, 5 up, 6 in 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/994010142' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997] boot 2026-02-12T10:54:30.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: osdmap e41: 6 total, 6 up, 6 in 2026-02-12T10:54:30.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:30 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 127 KiB/s, 0 objects/s recovering 2026-02-12T10:54:30.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial157", "root=default"]}]': finished 2026-02-12T10:54:30.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: osdmap e40: 6 total, 5 up, 6 in 2026-02-12T10:54:30.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/994010142' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: osd.5 [v2:10.20.193.157:6808/3024956997,v1:10.20.193.157:6809/3024956997] boot 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: osdmap e41: 6 total, 6 up, 6 in 2026-02-12T10:54:30.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:30 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-12T10:54:30.646 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd stat -f json 2026-02-12T10:54:30.798 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:30.997 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:31.035 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1770893670,"num_in_osds":6,"osd_in_since":1770893656,"num_remapped_pgs":1} 2026-02-12T10:54:31.036 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd dump --format=json 2026-02-12T10:54:31.183 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:31.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:31 trial028 ceph-mon[21167]: purged_snaps scrub starts 2026-02-12T10:54:31.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:31 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:54:31.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:31 trial028 ceph-mon[21167]: Detected new or changed devices on trial049 2026-02-12T10:54:31.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:31 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2607214278' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:31.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:31 trial028 ceph-mon[21167]: osdmap e42: 6 total, 6 up, 6 in 2026-02-12T10:54:31.378 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:31.378 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":42,"fsid":"edb480c7-0800-11f1-86ba-d404e6e7d460","created":"2026-02-12T10:52:44.278513+0000","modified":"2026-02-12T10:54:31.112939+0000","last_up_change":"2026-02-12T10:54:30.111797+0000","last_in_change":"2026-02-12T10:54:16.611934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T10:54:04.237838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8769b737-0add-48cd-948f-fdfa27c33ef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6803","nonce":3861244579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6805","nonce":3861244579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6809","nonce":3861244579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6807","nonce":3861244579}]},"public_addr":"10.20.193.28:6803/3861244579","cluster_addr":"10.20.193.28:6805/3861244579","heartbeat_back_addr":"10.20.193.28:6809/3861244579","heartbeat_front_addr":"10.20.193.28:6807/3861244579","state":["exists","up"]},{"osd":1,"uuid":"f7dbe173-df96-416d-b658-444de2f6cee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6811","nonce":3980599175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6813","nonce":3980599175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6817","nonce":3980599175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6815","nonce":3980599175}]},"public_addr":"10.20.193.28:6811/3980599175","cluster_addr":"10.20.193.28:6813/3980599175","heartbeat_back_addr":"10.20.193.28:6817/3980599175","heartbeat_front_addr":"10.20.193.28:6815/3980599175","state":["exists","up"]},{"osd":2,"uuid":"f4756a99-c709-4a0e-8b00-51dd8560610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6801","nonce":163238384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6803","nonce":163238384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6807","nonce":163238384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6805","nonce":163238384}]},"public_addr":"10.20.193.49:6801/163238384","cluster_addr":"10.20.193.49:6803/163238384","heartbeat_back_addr":"10.20.193.49:6807/163238384","heartbeat_front_addr":"10.20.193.49:6805/163238384","state":["exists","up"]},{"osd":3,"uuid":"e0663ad8-4255-4201-8641-f02cd1665fae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6809","nonce":3168734430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6811","nonce":3168734430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6814","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6815","nonce":3168734430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6813","nonce":3168734430}]},"public_addr":"10.20.193.49:6809/3168734430","cluster_addr":"10.20.193.49:6811/3168734430","heartbeat_back_addr":"10.20.193.49:6815/3168734430","heartbeat_front_addr":"10.20.193.49:6813/3168734430","state":["exists","up"]},{"osd":4,"uuid":"2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6800","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6801","nonce":2322913599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6802","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6803","nonce":2322913599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6806","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6807","nonce":2322913599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6804","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6805","nonce":2322913599}]},"public_addr":"10.20.193.157:6801/2322913599","cluster_addr":"10.20.193.157:6803/2322913599","heartbeat_back_addr":"10.20.193.157:6807/2322913599","heartbeat_front_addr":"10.20.193.157:6805/2322913599","state":["exists","up"]},{"osd":5,"uuid":"38584f1f-b59a-4a51-a52d-b3ffc0ce9f09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6808","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6809","nonce":3024956997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6810","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6811","nonce":3024956997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6814","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6815","nonce":3024956997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6812","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6813","nonce":3024956997}]},"public_addr":"10.20.193.157:6809/3024956997","cluster_addr":"10.20.193.157:6811/3024956997","heartbeat_back_addr":"10.20.193.157:6815/3024956997","heartbeat_front_addr":"10.20.193.157:6813/3024956997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:53:43.538988+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:53:51.784214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:01.647063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:10.269420+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:19.581354+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:28.563332+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[3,2]}],"primary_temp":[],"blocklist":{"10.20.193.28:6800/3558316715":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/2637516948":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/4266047412":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/3309412710":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/308407764":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6801/3558316715":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/2972898879":"2026-02-13T10:52:54.015960+0000","10.20.193.28:0/2452548924":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6801/502915368":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6800/502915368":"2026-02-13T10:52:54.015960+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T10:54:31.414 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-12T10:54:04.237838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-12T10:54:31.414 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-12T10:54:31.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:31 trial157 ceph-mon[22230]: purged_snaps scrub starts 2026-02-12T10:54:31.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:31 trial157 ceph-mon[22230]: purged_snaps scrub ok 2026-02-12T10:54:31.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:31 trial157 ceph-mon[22230]: Detected new or changed devices on trial049 2026-02-12T10:54:31.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:31 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/2607214278' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:31.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:31 trial157 ceph-mon[22230]: osdmap e42: 6 total, 6 up, 6 in 2026-02-12T10:54:31.514 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:31 trial049 ceph-mon[22099]: purged_snaps scrub starts 2026-02-12T10:54:31.514 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:31 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:54:31.514 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:31 trial049 ceph-mon[22099]: Detected new or changed devices on trial049 2026-02-12T10:54:31.514 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:31 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/2607214278' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-12T10:54:31.515 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:31 trial049 ceph-mon[22099]: osdmap e42: 6 total, 6 up, 6 in 2026-02-12T10:54:31.565 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:31.758 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-12T10:54:31.795 INFO:tasks.cephadm:Setting up client nodes... 2026-02-12T10:54:31.795 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T10:54:31.795 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-12T10:54:31.795 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-12T10:54:31.943 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:32.154 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:32.189 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":15,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":4287027055},{"type":"v1","addr":"10.20.193.28:6801","nonce":4287027055}]},"active_addr":"10.20.193.28:6801/4287027055","active_change":"2026-02-12T10:53:02.199333+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14214,"name":"b","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.28:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":1927627177}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":2632734319}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":3492933207}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":3413064617}]}]} 2026-02-12T10:54:32.247 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-12T10:54:32.247 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-12T10:54:32.247 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd dump --format=json 2026-02-12T10:54:32.270 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:32 trial028 ceph-mon[21167]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:32.271 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:32 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3422688796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:32.271 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:32 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3677443401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-12T10:54:32.271 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:32 trial028 ceph-mon[21167]: osdmap e43: 6 total, 6 up, 6 in 2026-02-12T10:54:32.396 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:32.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:32 trial157 ceph-mon[22230]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:32.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:32 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3422688796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:32.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:32 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3677443401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-12T10:54:32.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:32 trial157 ceph-mon[22230]: osdmap e43: 6 total, 6 up, 6 in 2026-02-12T10:54:32.594 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:32.594 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":43,"fsid":"edb480c7-0800-11f1-86ba-d404e6e7d460","created":"2026-02-12T10:52:44.278513+0000","modified":"2026-02-12T10:54:32.114019+0000","last_up_change":"2026-02-12T10:54:30.111797+0000","last_in_change":"2026-02-12T10:54:16.611934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T10:54:04.237838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8769b737-0add-48cd-948f-fdfa27c33ef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6803","nonce":3861244579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6805","nonce":3861244579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6809","nonce":3861244579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6807","nonce":3861244579}]},"public_addr":"10.20.193.28:6803/3861244579","cluster_addr":"10.20.193.28:6805/3861244579","heartbeat_back_addr":"10.20.193.28:6809/3861244579","heartbeat_front_addr":"10.20.193.28:6807/3861244579","state":["exists","up"]},{"osd":1,"uuid":"f7dbe173-df96-416d-b658-444de2f6cee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6811","nonce":3980599175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6813","nonce":3980599175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6817","nonce":3980599175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6815","nonce":3980599175}]},"public_addr":"10.20.193.28:6811/3980599175","cluster_addr":"10.20.193.28:6813/3980599175","heartbeat_back_addr":"10.20.193.28:6817/3980599175","heartbeat_front_addr":"10.20.193.28:6815/3980599175","state":["exists","up"]},{"osd":2,"uuid":"f4756a99-c709-4a0e-8b00-51dd8560610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6801","nonce":163238384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6803","nonce":163238384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6807","nonce":163238384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6805","nonce":163238384}]},"public_addr":"10.20.193.49:6801/163238384","cluster_addr":"10.20.193.49:6803/163238384","heartbeat_back_addr":"10.20.193.49:6807/163238384","heartbeat_front_addr":"10.20.193.49:6805/163238384","state":["exists","up"]},{"osd":3,"uuid":"e0663ad8-4255-4201-8641-f02cd1665fae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6809","nonce":3168734430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6811","nonce":3168734430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6814","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6815","nonce":3168734430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6813","nonce":3168734430}]},"public_addr":"10.20.193.49:6809/3168734430","cluster_addr":"10.20.193.49:6811/3168734430","heartbeat_back_addr":"10.20.193.49:6815/3168734430","heartbeat_front_addr":"10.20.193.49:6813/3168734430","state":["exists","up"]},{"osd":4,"uuid":"2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6800","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6801","nonce":2322913599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6802","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6803","nonce":2322913599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6806","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6807","nonce":2322913599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6804","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6805","nonce":2322913599}]},"public_addr":"10.20.193.157:6801/2322913599","cluster_addr":"10.20.193.157:6803/2322913599","heartbeat_back_addr":"10.20.193.157:6807/2322913599","heartbeat_front_addr":"10.20.193.157:6805/2322913599","state":["exists","up"]},{"osd":5,"uuid":"38584f1f-b59a-4a51-a52d-b3ffc0ce9f09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6808","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6809","nonce":3024956997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6810","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6811","nonce":3024956997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6814","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6815","nonce":3024956997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6812","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6813","nonce":3024956997}]},"public_addr":"10.20.193.157:6809/3024956997","cluster_addr":"10.20.193.157:6811/3024956997","heartbeat_back_addr":"10.20.193.157:6815/3024956997","heartbeat_front_addr":"10.20.193.157:6813/3024956997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:53:43.538988+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:53:51.784214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:01.647063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:10.269420+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:19.581354+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:28.563332+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[3,2]}],"primary_temp":[],"blocklist":{"10.20.193.28:6800/3558316715":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/2637516948":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/4266047412":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/3309412710":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/308407764":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6801/3558316715":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/2972898879":"2026-02-13T10:52:54.015960+0000","10.20.193.28:0/2452548924":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6801/502915368":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6800/502915368":"2026-02-13T10:52:54.015960+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T10:54:32.631 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-12T10:54:32.631 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd dump --format=json 2026-02-12T10:54:32.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:32 trial049 ceph-mon[22099]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:32.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:32 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3422688796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:32.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:32 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3677443401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-12T10:54:32.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:32 trial049 ceph-mon[22099]: osdmap e43: 6 total, 6 up, 6 in 2026-02-12T10:54:32.821 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.014 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:33.014 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":43,"fsid":"edb480c7-0800-11f1-86ba-d404e6e7d460","created":"2026-02-12T10:52:44.278513+0000","modified":"2026-02-12T10:54:32.114019+0000","last_up_change":"2026-02-12T10:54:30.111797+0000","last_in_change":"2026-02-12T10:54:16.611934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T10:54:04.237838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8769b737-0add-48cd-948f-fdfa27c33ef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6803","nonce":3861244579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6805","nonce":3861244579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6809","nonce":3861244579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3861244579},{"type":"v1","addr":"10.20.193.28:6807","nonce":3861244579}]},"public_addr":"10.20.193.28:6803/3861244579","cluster_addr":"10.20.193.28:6805/3861244579","heartbeat_back_addr":"10.20.193.28:6809/3861244579","heartbeat_front_addr":"10.20.193.28:6807/3861244579","state":["exists","up"]},{"osd":1,"uuid":"f7dbe173-df96-416d-b658-444de2f6cee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6811","nonce":3980599175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6813","nonce":3980599175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6817","nonce":3980599175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3980599175},{"type":"v1","addr":"10.20.193.28:6815","nonce":3980599175}]},"public_addr":"10.20.193.28:6811/3980599175","cluster_addr":"10.20.193.28:6813/3980599175","heartbeat_back_addr":"10.20.193.28:6817/3980599175","heartbeat_front_addr":"10.20.193.28:6815/3980599175","state":["exists","up"]},{"osd":2,"uuid":"f4756a99-c709-4a0e-8b00-51dd8560610a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6800","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6801","nonce":163238384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6802","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6803","nonce":163238384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6806","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6807","nonce":163238384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6804","nonce":163238384},{"type":"v1","addr":"10.20.193.49:6805","nonce":163238384}]},"public_addr":"10.20.193.49:6801/163238384","cluster_addr":"10.20.193.49:6803/163238384","heartbeat_back_addr":"10.20.193.49:6807/163238384","heartbeat_front_addr":"10.20.193.49:6805/163238384","state":["exists","up"]},{"osd":3,"uuid":"e0663ad8-4255-4201-8641-f02cd1665fae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6808","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6809","nonce":3168734430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6810","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6811","nonce":3168734430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6814","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6815","nonce":3168734430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.49:6812","nonce":3168734430},{"type":"v1","addr":"10.20.193.49:6813","nonce":3168734430}]},"public_addr":"10.20.193.49:6809/3168734430","cluster_addr":"10.20.193.49:6811/3168734430","heartbeat_back_addr":"10.20.193.49:6815/3168734430","heartbeat_front_addr":"10.20.193.49:6813/3168734430","state":["exists","up"]},{"osd":4,"uuid":"2399b0bf-79b2-4ca5-b8cc-0aee5ce43f17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6800","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6801","nonce":2322913599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6802","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6803","nonce":2322913599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6806","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6807","nonce":2322913599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6804","nonce":2322913599},{"type":"v1","addr":"10.20.193.157:6805","nonce":2322913599}]},"public_addr":"10.20.193.157:6801/2322913599","cluster_addr":"10.20.193.157:6803/2322913599","heartbeat_back_addr":"10.20.193.157:6807/2322913599","heartbeat_front_addr":"10.20.193.157:6805/2322913599","state":["exists","up"]},{"osd":5,"uuid":"38584f1f-b59a-4a51-a52d-b3ffc0ce9f09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6808","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6809","nonce":3024956997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6810","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6811","nonce":3024956997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6814","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6815","nonce":3024956997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.157:6812","nonce":3024956997},{"type":"v1","addr":"10.20.193.157:6813","nonce":3024956997}]},"public_addr":"10.20.193.157:6809/3024956997","cluster_addr":"10.20.193.157:6811/3024956997","heartbeat_back_addr":"10.20.193.157:6815/3024956997","heartbeat_front_addr":"10.20.193.157:6813/3024956997","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:53:43.538988+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:53:51.784214+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:01.647063+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:10.269420+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:19.581354+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T10:54:28.563332+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[3,2]}],"primary_temp":[],"blocklist":{"10.20.193.28:6800/3558316715":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/2637516948":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/4266047412":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/3309412710":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/308407764":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6801/3558316715":"2026-02-13T10:53:02.199247+0000","10.20.193.28:0/2972898879":"2026-02-13T10:52:54.015960+0000","10.20.193.28:0/2452548924":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6801/502915368":"2026-02-13T10:52:54.015960+0000","10.20.193.28:6800/502915368":"2026-02-13T10:52:54.015960+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T10:54:33.050 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-12T10:54:33.051 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-12T10:54:33.051 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-12T10:54:33.052 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-12T10:54:33.052 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-12T10:54:33.052 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-12T10:54:33.259 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.260 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.304 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.304 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.305 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.373 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:33 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3368974222' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:33 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/540701144' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:33 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/353030167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:33 trial028 ceph-mon[21167]: osdmap e44: 6 total, 6 up, 6 in 2026-02-12T10:54:33.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:33 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3368974222' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:33 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/540701144' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:33 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/353030167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:33 trial157 ceph-mon[22230]: osdmap e44: 6 total, 6 up, 6 in 2026-02-12T10:54:33.453 INFO:teuthology.orchestra.run.trial028.stdout:137438953477 2026-02-12T10:54:33.453 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-12T10:54:33.461 INFO:teuthology.orchestra.run.trial028.stdout:38654705677 2026-02-12T10:54:33.462 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-12T10:54:33.490 INFO:teuthology.orchestra.run.trial028.stdout:176093659138 2026-02-12T10:54:33.491 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-12T10:54:33.492 INFO:teuthology.orchestra.run.trial028.stdout:73014444040 2026-02-12T10:54:33.492 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-12T10:54:33.501 INFO:teuthology.orchestra.run.trial028.stdout:103079215111 2026-02-12T10:54:33.501 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-12T10:54:33.532 INFO:teuthology.orchestra.run.trial028.stdout:55834574859 2026-02-12T10:54:33.533 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-12T10:54:33.613 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:33 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3368974222' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:33 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/540701144' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:33 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/353030167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-12T10:54:33.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:33 trial049 ceph-mon[22099]: osdmap e44: 6 total, 6 up, 6 in 2026-02-12T10:54:33.682 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.683 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.683 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.762 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.784 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:33.819 INFO:teuthology.orchestra.run.trial028.stdout:137438953476 2026-02-12T10:54:33.861 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953477 got 137438953476 for osd.4 2026-02-12T10:54:33.892 INFO:teuthology.orchestra.run.trial028.stdout:73014444039 2026-02-12T10:54:33.897 INFO:teuthology.orchestra.run.trial028.stdout:38654705676 2026-02-12T10:54:33.902 INFO:teuthology.orchestra.run.trial028.stdout:176093659137 2026-02-12T10:54:33.944 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705677 got 38654705676 for osd.0 2026-02-12T10:54:33.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659138 got 176093659137 for osd.5 2026-02-12T10:54:33.949 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444040 got 73014444039 for osd.2 2026-02-12T10:54:33.971 INFO:teuthology.orchestra.run.trial028.stdout:55834574858 2026-02-12T10:54:33.972 INFO:teuthology.orchestra.run.trial028.stdout:103079215110 2026-02-12T10:54:34.010 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215111 got 103079215110 for osd.3 2026-02-12T10:54:34.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2026-02-12T10:54:34.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:34.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3134369527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T10:54:34.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3883544937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T10:54:34.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/1558882155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T10:54:34.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/673658629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T10:54:34.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3490581024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T10:54:34.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/1146910930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T10:54:34.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:34 trial028 ceph-mon[21167]: osdmap e45: 6 total, 6 up, 6 in 2026-02-12T10:54:34.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:34.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3134369527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T10:54:34.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3883544937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T10:54:34.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/1558882155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T10:54:34.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/673658629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T10:54:34.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3490581024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T10:54:34.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/1146910930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T10:54:34.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:34 trial157 ceph-mon[22230]: osdmap e45: 6 total, 6 up, 6 in 2026-02-12T10:54:34.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:34.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3134369527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T10:54:34.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3883544937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T10:54:34.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/1558882155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T10:54:34.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/673658629' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T10:54:34.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3490581024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T10:54:34.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/1146910930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T10:54:34.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:34 trial049 ceph-mon[22099]: osdmap e45: 6 total, 6 up, 6 in 2026-02-12T10:54:34.862 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-12T10:54:34.944 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-12T10:54:34.945 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-12T10:54:34.950 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-12T10:54:35.010 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-12T10:54:35.010 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:35.018 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-12T10:54:35.124 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:35.124 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:35.212 INFO:teuthology.orchestra.run.trial028.stdout:137438953477 2026-02-12T10:54:35.212 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:35.242 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:35.252 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953477 got 137438953477 for osd.4 2026-02-12T10:54:35.252 DEBUG:teuthology.parallel:result is None 2026-02-12T10:54:35.287 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:35.342 INFO:teuthology.orchestra.run.trial028.stdout:38654705677 2026-02-12T10:54:35.348 INFO:teuthology.orchestra.run.trial028.stdout:176093659138 2026-02-12T10:54:35.386 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705677 got 38654705677 for osd.0 2026-02-12T10:54:35.387 DEBUG:teuthology.parallel:result is None 2026-02-12T10:54:35.394 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659138 got 176093659138 for osd.5 2026-02-12T10:54:35.394 DEBUG:teuthology.parallel:result is None 2026-02-12T10:54:35.425 INFO:teuthology.orchestra.run.trial028.stdout:73014444041 2026-02-12T10:54:35.428 INFO:teuthology.orchestra.run.trial028.stdout:103079215111 2026-02-12T10:54:35.465 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444040 got 73014444041 for osd.2 2026-02-12T10:54:35.465 DEBUG:teuthology.parallel:result is None 2026-02-12T10:54:35.468 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215111 got 103079215111 for osd.3 2026-02-12T10:54:35.468 DEBUG:teuthology.parallel:result is None 2026-02-12T10:54:35.495 INFO:teuthology.orchestra.run.trial028.stdout:55834574860 2026-02-12T10:54:35.531 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.1 2026-02-12T10:54:35.531 DEBUG:teuthology.parallel:result is None 2026-02-12T10:54:35.531 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-12T10:54:35.531 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph pg dump --format=json 2026-02-12T10:54:35.721 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:35.908 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:35.909 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-12T10:54:35.943 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2026-02-12T10:54:34.650241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":4,"kb":4404019200,"kb_used":166600,"kb_used_data":4768,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":4403852600,"statfs":{"total":4509715660800,"available":4509545062400,"internally_reserved":0,"allocated":4882432,"data_stored":3314147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9560,"internal_metadata":165534376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000463"},"pg_stats":[{"pgid":"1.0","version":"19'132","reported_seq":237,"reported_epoch":43,"state":"peering","last_fresh":"2026-02-12T10:54:32.121592+0000","last_change":"2026-02-12T10:54:33.117759+0000","last_active":"2026-02-12T10:54:33.117759+0000","last_peered":"2026-02-12T10:54:32.121592+0000","last_clean":"2026-02-12T10:54:28.945654+0000","last_became_active":"2026-02-12T10:54:32.119223+0000","last_became_peered":"2026-02-12T10:54:32.119223+0000","last_unstale":"2026-02-12T10:54:32.121592+0000","last_undegraded":"2026-02-12T10:54:32.121592+0000","last_fullsized":"2026-02-12T10:54:32.116046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_clean_scrub_stamp":"2026-02-12T10:54:04.623911+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":41,"seq":176093659138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1003520,"data_stored":745980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1003520,"data_stored":745980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27960,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975240,"statfs":{"total":751619276800,"available":751590645760,"internally_reserved":0,"allocated":1015808,"data_stored":750736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27388,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975812,"statfs":{"total":751619276800,"available":751591231488,"internally_reserved":0,"allocated":421888,"data_stored":160368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27372,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975828,"statfs":{"total":751619276800,"available":751591247872,"internally_reserved":0,"allocated":409600,"data_stored":155612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T10:54:35.944 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph pg dump --format=json 2026-02-12T10:54:36.092 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:36.278 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:36.278 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-12T10:54:36.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:36 trial028 ceph-mon[21167]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-12T10:54:36.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:36 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/794116416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T10:54:36.285 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:36 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/1511223725' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T10:54:36.285 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:36 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/1697141224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T10:54:36.285 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:36 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3113345814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T10:54:36.285 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:36 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/2911550800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T10:54:36.285 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:36 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/1136029313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T10:54:36.313 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2026-02-12T10:54:34.650241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":4,"kb":4404019200,"kb_used":166600,"kb_used_data":4768,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":4403852600,"statfs":{"total":4509715660800,"available":4509545062400,"internally_reserved":0,"allocated":4882432,"data_stored":3314147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9560,"internal_metadata":165534376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000463"},"pg_stats":[{"pgid":"1.0","version":"19'132","reported_seq":237,"reported_epoch":43,"state":"peering","last_fresh":"2026-02-12T10:54:32.121592+0000","last_change":"2026-02-12T10:54:33.117759+0000","last_active":"2026-02-12T10:54:33.117759+0000","last_peered":"2026-02-12T10:54:32.121592+0000","last_clean":"2026-02-12T10:54:28.945654+0000","last_became_active":"2026-02-12T10:54:32.119223+0000","last_became_peered":"2026-02-12T10:54:32.119223+0000","last_unstale":"2026-02-12T10:54:32.121592+0000","last_undegraded":"2026-02-12T10:54:32.121592+0000","last_fullsized":"2026-02-12T10:54:32.116046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_clean_scrub_stamp":"2026-02-12T10:54:04.623911+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":41,"seq":176093659138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1003520,"data_stored":745980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1003520,"data_stored":745980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27960,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975240,"statfs":{"total":751619276800,"available":751590645760,"internally_reserved":0,"allocated":1015808,"data_stored":750736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27388,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975812,"statfs":{"total":751619276800,"available":751591231488,"internally_reserved":0,"allocated":421888,"data_stored":160368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27372,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975828,"statfs":{"total":751619276800,"available":751591247872,"internally_reserved":0,"allocated":409600,"data_stored":155612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T10:54:36.315 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph pg dump --format=json 2026-02-12T10:54:36.433 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:36 trial049 ceph-mon[22099]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-12T10:54:36.433 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:36 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/794116416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T10:54:36.433 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:36 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/1511223725' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T10:54:36.433 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:36 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/1697141224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T10:54:36.433 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:36 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3113345814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T10:54:36.433 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:36 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/2911550800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T10:54:36.433 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:36 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/1136029313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T10:54:36.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:36 trial157 ceph-mon[22230]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-12T10:54:36.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:36 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/794116416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-12T10:54:36.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:36 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/1511223725' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-12T10:54:36.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:36 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/1697141224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-12T10:54:36.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:36 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/3113345814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-12T10:54:36.434 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:36 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/2911550800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-12T10:54:36.435 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:36 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/1136029313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-12T10:54:36.463 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:36.651 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:36.651 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-12T10:54:36.688 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2026-02-12T10:54:34.650241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":4,"kb":4404019200,"kb_used":166600,"kb_used_data":4768,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":4403852600,"statfs":{"total":4509715660800,"available":4509545062400,"internally_reserved":0,"allocated":4882432,"data_stored":3314147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9560,"internal_metadata":165534376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000463"},"pg_stats":[{"pgid":"1.0","version":"19'132","reported_seq":237,"reported_epoch":43,"state":"peering","last_fresh":"2026-02-12T10:54:32.121592+0000","last_change":"2026-02-12T10:54:33.117759+0000","last_active":"2026-02-12T10:54:33.117759+0000","last_peered":"2026-02-12T10:54:32.121592+0000","last_clean":"2026-02-12T10:54:28.945654+0000","last_became_active":"2026-02-12T10:54:32.119223+0000","last_became_peered":"2026-02-12T10:54:32.119223+0000","last_unstale":"2026-02-12T10:54:32.121592+0000","last_undegraded":"2026-02-12T10:54:32.121592+0000","last_fullsized":"2026-02-12T10:54:32.116046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_clean_scrub_stamp":"2026-02-12T10:54:04.623911+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":41,"seq":176093659138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1003520,"data_stored":745980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1003520,"data_stored":745980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27960,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975240,"statfs":{"total":751619276800,"available":751590645760,"internally_reserved":0,"allocated":1015808,"data_stored":750736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27388,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975812,"statfs":{"total":751619276800,"available":751591231488,"internally_reserved":0,"allocated":421888,"data_stored":160368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27372,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975828,"statfs":{"total":751619276800,"available":751591247872,"internally_reserved":0,"allocated":409600,"data_stored":155612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T10:54:36.689 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2026-02-12T10:54:36.689 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "19'132", 'reported_seq': 237, 'reported_epoch': 43, 'state': 'peering', 'last_fresh': '2026-02-12T10:54:32.121592+0000', 'last_change': '2026-02-12T10:54:33.117759+0000', 'last_active': '2026-02-12T10:54:33.117759+0000', 'last_peered': '2026-02-12T10:54:32.121592+0000', 'last_clean': '2026-02-12T10:54:28.945654+0000', 'last_became_active': '2026-02-12T10:54:32.119223+0000', 'last_became_peered': '2026-02-12T10:54:32.119223+0000', 'last_unstale': '2026-02-12T10:54:32.121592+0000', 'last_undegraded': '2026-02-12T10:54:32.121592+0000', 'last_fullsized': '2026-02-12T10:54:32.116046+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 36, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-12T10:54:04.623911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-12T10:54:04.623911+0000', 'last_clean_scrub_stamp': '2026-02-12T10:54:04.623911+0000', 'objects_scrubbed': 0, 'log_size': 132, 'log_dups_size': 0, 'ondisk_log_size': 132, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 590368, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 96, 'num_read_kb': 82, 'num_write': 167, 'num_write_kb': 3194, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 6, 'num_bytes_recovered': 1771104, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5, 2], 'acting': [3, 5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 4, 5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2026-02-12T10:54:36.689 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph status --format=json 2026-02-12T10:54:36.836 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:37.059 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:37.059 INFO:teuthology.orchestra.run.trial028.stdout:{"fsid":"edb480c7-0800-11f1-86ba-d404e6e7d460","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":71,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":6,"num_up_osds":6,"osd_up_since":1770893670,"num_in_osds":6,"osd_in_since":1770893656,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"peering","count":1}],"num_pgs":1,"num_pools":1,"num_objects":2,"data_bytes":590368,"bytes_used":170598400,"bytes_avail":4509545062400,"bytes_total":4509715660800,"inactive_pgs_ratio":1,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":147574,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0},"fsmap":{"epoch":1,"btime":"2026-02-12T10:52:44:278375+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://10.20.193.28:8443/"}},"servicemap":{"epoch":5,"modified":"2026-02-12T10:54:32.650050+0000","services":{"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2026-02-12T10:54:37.095 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2026-02-12T10:54:37.095 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph pg dump --format=json 2026-02-12T10:54:37.245 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:37.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:37 trial157 ceph-mon[22230]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:37.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:37 trial157 ceph-mon[22230]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:37.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:37 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/4085632689' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-12T10:54:37.439 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:37.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:37 trial028 ceph-mon[21167]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:37.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:37 trial028 ceph-mon[21167]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:37.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:37 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/4085632689' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-12T10:54:37.439 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-12T10:54:37.475 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2026-02-12T10:54:36.650510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":4404019200,"kb_used":166096,"kb_used_data":4272,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":4403853104,"statfs":{"total":4509715660800,"available":4509545578496,"internally_reserved":0,"allocated":4374528,"data_stored":2756987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9560,"internal_metadata":165534376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.536166"},"pg_stats":[{"pgid":"1.0","version":"19'132","reported_seq":246,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-12T10:54:34.119732+0000","last_change":"2026-02-12T10:54:34.119732+0000","last_active":"2026-02-12T10:54:34.119732+0000","last_peered":"2026-02-12T10:54:34.119732+0000","last_clean":"2026-02-12T10:54:34.119732+0000","last_became_active":"2026-02-12T10:54:34.119453+0000","last_became_peered":"2026-02-12T10:54:34.119453+0000","last_unstale":"2026-02-12T10:54:34.119732+0000","last_undegraded":"2026-02-12T10:54:34.119732+0000","last_fullsized":"2026-02-12T10:54:34.119732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_clean_scrub_stamp":"2026-02-12T10:54:04.623911+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:09:33.098505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":41,"seq":176093659139,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27396,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975804,"statfs":{"total":751619276800,"available":751591223296,"internally_reserved":0,"allocated":434176,"data_stored":165103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215112,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27976,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975224,"statfs":{"total":751619276800,"available":751590629376,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27388,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975812,"statfs":{"total":751619276800,"available":751591231488,"internally_reserved":0,"allocated":421888,"data_stored":160368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27392,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975808,"statfs":{"total":751619276800,"available":751591227392,"internally_reserved":0,"allocated":434176,"data_stored":165103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T10:54:37.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:37 trial049 ceph-mon[22099]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:37.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:37 trial049 ceph-mon[22099]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:37.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:37 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/4085632689' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-12T10:54:38.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:38 trial157 ceph-mon[22230]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:38.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:38 trial157 ceph-mon[22230]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 104 KiB/s, 0 objects/s recovering 2026-02-12T10:54:38.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:38 trial157 ceph-mon[22230]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:38.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:38 trial028 ceph-mon[21167]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:38.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:38 trial028 ceph-mon[21167]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 104 KiB/s, 0 objects/s recovering 2026-02-12T10:54:38.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:38 trial028 ceph-mon[21167]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:38.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:38 trial049 ceph-mon[22099]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:38.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:38 trial049 ceph-mon[22099]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 104 KiB/s, 0 objects/s recovering 2026-02-12T10:54:38.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:38 trial049 ceph-mon[22099]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:40.433 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:40 trial157 ceph-mon[22230]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 88 KiB/s, 0 objects/s recovering 2026-02-12T10:54:40.476 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph pg dump --format=json 2026-02-12T10:54:40.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:40 trial028 ceph-mon[21167]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 88 KiB/s, 0 objects/s recovering 2026-02-12T10:54:40.626 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:40.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:40 trial049 ceph-mon[22099]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 88 KiB/s, 0 objects/s recovering 2026-02-12T10:54:40.825 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:40.825 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-12T10:54:40.860 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2026-02-12T10:54:40.651006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":4404019200,"kb_used":166100,"kb_used_data":4284,"kb_used_omap":9,"kb_used_meta":161654,"kb_avail":4403853100,"statfs":{"total":4509715660800,"available":4509545574400,"internally_reserved":0,"allocated":4386816,"data_stored":2761722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9560,"internal_metadata":165534376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000983"},"pg_stats":[{"pgid":"1.0","version":"19'132","reported_seq":246,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-12T10:54:34.119732+0000","last_change":"2026-02-12T10:54:34.119732+0000","last_active":"2026-02-12T10:54:34.119732+0000","last_peered":"2026-02-12T10:54:34.119732+0000","last_clean":"2026-02-12T10:54:34.119732+0000","last_became_active":"2026-02-12T10:54:34.119453+0000","last_became_peered":"2026-02-12T10:54:34.119453+0000","last_unstale":"2026-02-12T10:54:34.119732+0000","last_undegraded":"2026-02-12T10:54:34.119732+0000","last_fullsized":"2026-02-12T10:54:34.119732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T10:54:04.623911+0000","last_clean_scrub_stamp":"2026-02-12T10:54:04.623911+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:09:33.098505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":167,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":3,"acting":3,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":41,"seq":176093659140,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27396,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975804,"statfs":{"total":751619276800,"available":751591223296,"internally_reserved":0,"allocated":434176,"data_stored":165103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215112,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27976,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975224,"statfs":{"total":751619276800,"available":751590629376,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1028096,"data_stored":755471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27392,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975808,"statfs":{"total":751619276800,"available":751591227392,"internally_reserved":0,"allocated":434176,"data_stored":165103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27392,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975808,"statfs":{"total":751619276800,"available":751591227392,"internally_reserved":0,"allocated":434176,"data_stored":165103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T10:54:40.861 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-12T10:54:40.861 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T10:54:40.861 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-12T10:54:40.861 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph health --format=json 2026-02-12T10:54:41.048 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:41.251 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-12T10:54:41.251 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T10:54:41.287 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-12T10:54:41.287 INFO:tasks.cephadm:Setup complete, yielding 2026-02-12T10:54:41.287 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-12T10:54:41.298 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- bash -c 'set -ex 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> HOSTNAMES=$(ceph orch host ls --format json | jq -r '"'"'.[] | .hostname'"'"') 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> for host in $HOSTNAMES; do 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # find the hostname for "host.c" which will have no mgr 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> HAS_MGRS=$(ceph orch ps --hostname ${host} --format json | jq '"'"'any(.daemon_type == "mgr")'"'"') 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> if [ "$HAS_MGRS" == "false" ]; then 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> HOST_C="${host}" 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> fi 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> done 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # One last thing to worry about before draining the host 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # is that the teuthology test tends to put the explicit 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # hostnames in the placement for the mon service. 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # We want to make sure we can drain without providing 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # --force and there is a check for the host being removed 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # being listed explicitly in the placements. Therefore, 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # we should remove it from the mon placement. 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> ceph orch ls mon --export > mon.yaml 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> sed /"$HOST_C"/d mon.yaml > mon_adjusted.yaml 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> ceph orch apply -i mon_adjusted.yaml 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # now drain that host 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> ceph orch host drain $HOST_C --zap-osd-devices 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # wait for drain to complete 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> HOST_C_DAEMONS=$(ceph orch ps --hostname $HOST_C) 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> while [ "$HOST_C_DAEMONS" != "No daemons reported" ]; do 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> sleep 15 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> HOST_C_DAEMONS=$(ceph orch ps --hostname $HOST_C) 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> done 2026-02-12T10:54:41.299 DEBUG:teuthology.orchestra.run.trial028:> # we want to check the ability to remove the host from 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> # the CRUSH map, so we should first verify the host is in 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> # the CRUSH map. 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> ceph osd getcrushmap -o compiled-crushmap 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> crushtool -d compiled-crushmap -o crushmap.txt 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> CRUSH_MAP=$(cat crushmap.txt) 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> if ! grep -q "$HOST_C" <<< "$CRUSH_MAP"; then 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> printf "Expected to see $HOST_C in CRUSH map. Saw:\n\n$CRUSH_MAP" 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> exit 1 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> fi 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> # If the drain was successful, we should be able to remove the 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> # host without force with no issues. If there are still daemons 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> # we will get a response telling us to drain the host and a 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> # non-zero return code 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> ceph orch host rm $HOST_C --rm-crush-entry 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> # verify we'"'"'ve successfully removed the host from the CRUSH map 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> sleep 30 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> ceph osd getcrushmap -o compiled-crushmap 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> crushtool -d compiled-crushmap -o crushmap.txt 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> CRUSH_MAP=$(cat crushmap.txt) 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> if grep -q "$HOST_C" <<< "$CRUSH_MAP"; then 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> printf "Saw $HOST_C in CRUSH map after it should have been removed.\n\n$CRUSH_MAP" 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> exit 1 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> fi 2026-02-12T10:54:41.300 DEBUG:teuthology.orchestra.run.trial028:> ' 2026-02-12T10:54:41.450 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:54:41.507 INFO:teuthology.orchestra.run.trial028.stderr:++ ceph orch host ls --format json 2026-02-12T10:54:41.508 INFO:teuthology.orchestra.run.trial028.stderr:++ jq -r '.[] | .hostname' 2026-02-12T10:54:41.646 INFO:teuthology.orchestra.run.trial028.stderr:+ HOSTNAMES='trial028 2026-02-12T10:54:41.646 INFO:teuthology.orchestra.run.trial028.stderr:trial049 2026-02-12T10:54:41.646 INFO:teuthology.orchestra.run.trial028.stderr:trial157' 2026-02-12T10:54:41.646 INFO:teuthology.orchestra.run.trial028.stderr:+ for host in $HOSTNAMES 2026-02-12T10:54:41.646 INFO:teuthology.orchestra.run.trial028.stderr:++ ceph orch ps --hostname trial028 --format json 2026-02-12T10:54:41.646 INFO:teuthology.orchestra.run.trial028.stderr:++ jq 'any(.daemon_type == "mgr")' 2026-02-12T10:54:41.789 INFO:teuthology.orchestra.run.trial028.stderr:+ HAS_MGRS=true 2026-02-12T10:54:41.789 INFO:teuthology.orchestra.run.trial028.stderr:+ '[' true == false ']' 2026-02-12T10:54:41.789 INFO:teuthology.orchestra.run.trial028.stderr:+ for host in $HOSTNAMES 2026-02-12T10:54:41.789 INFO:teuthology.orchestra.run.trial028.stderr:++ ceph orch ps --hostname trial049 --format json 2026-02-12T10:54:41.789 INFO:teuthology.orchestra.run.trial028.stderr:++ jq 'any(.daemon_type == "mgr")' 2026-02-12T10:54:41.931 INFO:teuthology.orchestra.run.trial028.stderr:+ HAS_MGRS=true 2026-02-12T10:54:41.931 INFO:teuthology.orchestra.run.trial028.stderr:+ '[' true == false ']' 2026-02-12T10:54:41.931 INFO:teuthology.orchestra.run.trial028.stderr:+ for host in $HOSTNAMES 2026-02-12T10:54:41.931 INFO:teuthology.orchestra.run.trial028.stderr:++ ceph orch ps --hostname trial157 --format json 2026-02-12T10:54:41.932 INFO:teuthology.orchestra.run.trial028.stderr:++ jq 'any(.daemon_type == "mgr")' 2026-02-12T10:54:42.077 INFO:teuthology.orchestra.run.trial028.stderr:+ HAS_MGRS=false 2026-02-12T10:54:42.078 INFO:teuthology.orchestra.run.trial028.stderr:+ '[' false == false ']' 2026-02-12T10:54:42.078 INFO:teuthology.orchestra.run.trial028.stderr:+ HOST_C=trial157 2026-02-12T10:54:42.078 INFO:teuthology.orchestra.run.trial028.stderr:+ ceph orch ls mon --export 2026-02-12T10:54:42.220 INFO:teuthology.orchestra.run.trial028.stderr:+ sed /trial157/d mon.yaml 2026-02-12T10:54:42.221 INFO:teuthology.orchestra.run.trial028.stderr:+ ceph orch apply -i mon_adjusted.yaml 2026-02-12T10:54:42.362 INFO:teuthology.orchestra.run.trial028.stdout:Scheduled mon update... 2026-02-12T10:54:42.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:42 trial028 ceph-mon[21167]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-12T10:54:42.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:42 trial028 ceph-mon[21167]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:42.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:42 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/638664914' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-12T10:54:42.369 INFO:teuthology.orchestra.run.trial028.stderr:+ ceph orch host drain trial157 --zap-osd-devices 2026-02-12T10:54:42.425 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:42 trial157 ceph-mon[22230]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-12T10:54:42.425 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:42 trial157 ceph-mon[22230]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:42.425 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:42 trial157 ceph-mon[22230]: from='client.? 10.20.193.28:0/638664914' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-12T10:54:42.425 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:42 trial157 podman[32160]: 2026-02-12 10:54:42.389585551 +0000 UTC m=+0.010826180 container died 272f7d9964c96fd6f7ad2d89a2fa3450d309450a3793bc26aea01c92e17bc134 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-c, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-12T10:54:42.425 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:42 trial157 podman[32160]: 2026-02-12 10:54:42.398489646 +0000 UTC m=+0.019730276 container remove 272f7d9964c96fd6f7ad2d89a2fa3450d309450a3793bc26aea01c92e17bc134 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-c, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260202, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2) 2026-02-12T10:54:42.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:42 trial049 ceph-mon[22099]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-12T10:54:42.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:42 trial049 ceph-mon[22099]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:42.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:42 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/638664914' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-12T10:54:42.933 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:42 trial157 systemd[1]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.c.service: Deactivated successfully. 2026-02-12T10:54:42.934 INFO:journalctl@ceph.mon.c.trial157.stdout:Feb 12 10:54:42 trial157 systemd[1]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.c.service: Consumed 1.011s CPU time. 2026-02-12T10:54:44.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:54:44.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:54:44.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: OSD bench result of 115897.045255 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:44.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: purged_snaps scrub ok 2026-02-12T10:54:44.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: OSD bench result of 126688.707686 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:44.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial028", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='client.14583 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial049", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "mon", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch apply", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: Saving service mon spec with placement trial028:10.20.193.28=a;trial049:10.20.193.49=b;count:3 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: Safe to remove mon.c: new quorum should be ['a', 'b'] (from ['a', 'b']) 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: Removing monitor c from monmap... 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "mon rm", "name": "c"}]': finished 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: mon.b calling monitor election 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 60 KiB/s, 0 objects/s recovering 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: mon.a calling monitor election 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: monmap epoch 4 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: last_changed 2026-02-12T10:54:42.365653+0000 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: min_mon_release 19 (squid) 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: election_strategy: 1 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: 1: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.b 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: fsmap 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: osdmap e45: 6 total, 6 up, 6 in 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: mgrmap e15: a(active, since 102s), standbys: b 2026-02-12T10:54:44.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:44 trial028 ceph-mon[21167]: overall HEALTH_OK 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: OSD bench result of 115897.045255 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: purged_snaps scrub ok 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: OSD bench result of 126688.707686 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial028", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='client.14583 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial049", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch ls", "service_type": "mon", "export": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch apply", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: Saving service mon spec with placement trial028:10.20.193.28=a;trial049:10.20.193.49=b;count:3 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: Safe to remove mon.c: new quorum should be ['a', 'b'] (from ['a', 'b']) 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: Removing monitor c from monmap... 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "mon rm", "name": "c"}]': finished 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: mon.b calling monitor election 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 60 KiB/s, 0 objects/s recovering 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: mon.a calling monitor election 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: monmap epoch 4 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: fsid edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: last_changed 2026-02-12T10:54:42.365653+0000 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: created 2026-02-12T10:52:43.350494+0000 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: min_mon_release 19 (squid) 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: election_strategy: 1 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: 1: [v2:10.20.193.49:3300/0,v1:10.20.193.49:6789/0] mon.b 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: fsmap 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: osdmap e45: 6 total, 6 up, 6 in 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: mgrmap e15: a(active, since 102s), standbys: b 2026-02-12T10:54:44.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:44 trial049 ceph-mon[22099]: overall HEALTH_OK 2026-02-12T10:54:45.499 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: Removing daemon mon.c from trial157 -- ports [] 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.500 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:54:45.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:45 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:45.516 INFO:teuthology.orchestra.run.trial028.stdout:Scheduled to remove the following daemons from host 'trial157' 2026-02-12T10:54:45.516 INFO:teuthology.orchestra.run.trial028.stdout:type id 2026-02-12T10:54:45.517 INFO:teuthology.orchestra.run.trial028.stdout:-------------------- --------------- 2026-02-12T10:54:45.517 INFO:teuthology.orchestra.run.trial028.stdout:agent trial157 2026-02-12T10:54:45.517 INFO:teuthology.orchestra.run.trial028.stdout:osd 4 2026-02-12T10:54:45.517 INFO:teuthology.orchestra.run.trial028.stdout:osd 5 2026-02-12T10:54:45.526 INFO:teuthology.orchestra.run.trial028.stderr:++ ceph orch ps --hostname trial157 2026-02-12T10:54:45.674 INFO:teuthology.orchestra.run.trial028.stderr:+ HOST_C_DAEMONS='NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:agent.trial157 trial157 running 18s ago 93s - - 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:osd.4 trial157 running (32s) 18s ago 32s 42.5M 42.5G 19.2.3-680-g05b55d19 dcf18b7f874c 4ccdffb3e0f2 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:osd.5 trial157 running (23s) 18s ago 23s 14.1M 42.5G 19.2.3-680-g05b55d19 dcf18b7f874c 09ebeb5d6ac3 ' 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:+ '[' 'NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:agent.trial157 trial157 running 18s ago 93s - - 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:osd.4 trial157 running (32s) 18s ago 32s 42.5M 42.5G 19.2.3-680-g05b55d19 dcf18b7f874c 4ccdffb3e0f2 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:osd.5 trial157 running (23s) 18s ago 23s 14.1M 42.5G 19.2.3-680-g05b55d19 dcf18b7f874c 09ebeb5d6ac3 ' '!=' 'No daemons reported' ']' 2026-02-12T10:54:45.675 INFO:teuthology.orchestra.run.trial028.stderr:+ sleep 15 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: Removing daemon mon.c from trial157 -- ports [] 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:54:45.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:54:45.883 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:45 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.527 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:46.527 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Updating trial028:/etc/ceph/ceph.conf 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Updating trial049:/etc/ceph/ceph.conf 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Updating trial157:/etc/ceph/ceph.conf 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Updating trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Updating trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Updating trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Reconfiguring mon.a (monmap changed)... 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Reconfiguring daemon mon.a on trial028 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Reconfiguring mgr.a (monmap changed)... 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Reconfiguring daemon mgr.a on trial028 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch host drain", "hostname": "trial157", "zap_osd_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Added label _no_schedule to host trial157 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Added label _no_conf_keyring to host trial157 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: osd.4 crush weight is 0.68359375 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: osd.5 crush weight is 0.68359375 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Reconfiguring osd.0 (monmap changed)... 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: Reconfiguring daemon osd.0 on trial028 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.528 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:54:46.529 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:54:46.529 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:46 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Updating trial028:/etc/ceph/ceph.conf 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Updating trial049:/etc/ceph/ceph.conf 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Updating trial157:/etc/ceph/ceph.conf 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Updating trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Updating trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Updating trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Metadata not up to date on all hosts. Skipping non agent specs 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Reconfiguring mon.a (monmap changed)... 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Reconfiguring daemon mon.a on trial028 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Reconfiguring mgr.a (monmap changed)... 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Reconfiguring daemon mgr.a on trial028 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch host drain", "hostname": "trial157", "zap_osd_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Added label _no_schedule to host trial157 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Added label _no_conf_keyring to host trial157 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: osd.4 crush weight is 0.68359375 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush tree", "format": "json"}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: osd.5 crush weight is 0.68359375 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Reconfiguring osd.0 (monmap changed)... 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: Reconfiguring daemon osd.0 on trial028 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-12T10:54:46.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:46 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring osd.1 (monmap changed)... 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring daemon osd.1 on trial028 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring mon.b (monmap changed)... 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring daemon mon.b on trial049 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring mgr.b (monmap changed)... 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring daemon mgr.b on trial049 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring osd.2 (monmap changed)... 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: Reconfiguring daemon osd.2 on trial049 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-12T10:54:47.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring osd.1 (monmap changed)... 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring daemon osd.1 on trial028 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring mon.b (monmap changed)... 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring daemon mon.b on trial049 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring mgr.b (monmap changed)... 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring daemon mgr.b on trial049 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring osd.2 (monmap changed)... 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: Reconfiguring daemon osd.2 on trial049 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-12T10:54:48.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: Reconfiguring osd.3 (monmap changed)... 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: Reconfiguring daemon osd.3 on trial049 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: Reconfiguring osd.4 (monmap changed)... 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: Reconfiguring daemon osd.4 on trial157 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: Reconfiguring osd.5 (monmap changed)... 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: Reconfiguring daemon osd.5 on trial157 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:48 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.880 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:48.880 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: Reconfiguring osd.3 (monmap changed)... 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: Reconfiguring daemon osd.3 on trial049 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: Reconfiguring osd.4 (monmap changed)... 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: Reconfiguring daemon osd.4 on trial157 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: Reconfiguring osd.5 (monmap changed)... 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: Reconfiguring daemon osd.5 on trial157 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:48.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:48 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: Detected new or changed devices on trial157 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: Removing trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: Removing trial157:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: Removing trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"]}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"]}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush reweight", "name": "osd.5", "weight": 0.0}]: dispatch 2026-02-12T10:54:50.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:49 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:50.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: Detected new or changed devices on trial157 2026-02-12T10:54:50.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: Removing trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.conf 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: Removing trial157:/etc/ceph/ceph.client.admin.keyring 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: Removing trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"]}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"]}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush reweight", "name": "osd.5", "weight": 0.0}]: dispatch 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:50.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:49 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a[21163]: 2026-02-12T10:54:49.894+0000 7f3533f0d640 -1 mon.a@0(leader).osd e46 definitely_dead 0 2026-02-12T10:54:50.683 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 systemd[1]: Stopping Ceph osd.4 for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:54:50.683 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4[27337]: 2026-02-12T10:54:50.318+0000 7f07e12f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:54:50.683 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4[27337]: 2026-02-12T10:54:50.318+0000 7f07e12f7640 -1 osd.4 46 *** Got signal Terminated *** 2026-02-12T10:54:50.683 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4[27337]: 2026-02-12T10:54:50.318+0000 7f07e12f7640 -1 osd.4 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 podman[35291]: 2026-02-12 10:54:50.845625707 +0000 UTC m=+0.539638128 container died 4ccdffb3e0f2d9cb5a444c26de5264515d91bc88a63e6d44f55ff35563d40b31 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260202, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 podman[35291]: 2026-02-12 10:54:50.855068472 +0000 UTC m=+0.549080883 container remove 4ccdffb3e0f2d9cb5a444c26de5264515d91bc88a63e6d44f55ff35563d40b31 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 bash[35291]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:50 trial157 podman[35421]: 2026-02-12 10:54:50.989100724 +0000 UTC m=+0.016719510 container create 505f8da0e0128dbf5651a49f54ee35ce960ff56b7af93705436bc9206a04bc1d (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20260202, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, ceph=True, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 podman[35421]: 2026-02-12 10:54:51.022401814 +0000 UTC m=+0.050020610 container init 505f8da0e0128dbf5651a49f54ee35ce960ff56b7af93705436bc9206a04bc1d (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4-deactivate, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, ceph=True) 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 podman[35421]: 2026-02-12 10:54:51.02466086 +0000 UTC m=+0.052279656 container start 505f8da0e0128dbf5651a49f54ee35ce960ff56b7af93705436bc9206a04bc1d (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4-deactivate, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 podman[35421]: 2026-02-12 10:54:51.025136101 +0000 UTC m=+0.052754907 container attach 505f8da0e0128dbf5651a49f54ee35ce960ff56b7af93705436bc9206a04bc1d (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, ceph=True, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 podman[35421]: 2026-02-12 10:54:50.982175589 +0000 UTC m=+0.009794385 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-12T10:54:51.157 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 podman[35421]: 2026-02-12 10:54:51.152879941 +0000 UTC m=+0.180498738 container died 505f8da0e0128dbf5651a49f54ee35ce960ff56b7af93705436bc9206a04bc1d (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-12T10:54:51.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd crush reweight", "name": "osd.5", "weight": 0.0}]': finished 2026-02-12T10:54:51.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: osdmap e46: 6 total, 6 up, 6 in 2026-02-12T10:54:51.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: osd.5 weight is now 0.0 2026-02-12T10:54:51.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["4"]}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["4"]}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd down", "ids": ["4"]}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: Health check failed: 1 osds down (OSD_DOWN) 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd down", "ids": ["4"]}]': finished 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: osdmap e47: 6 total, 5 up, 6 in 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: osd.4 now down 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:50 trial028 ceph-mon[21167]: Removing daemon osd.4 from trial157 -- ports [] 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd crush reweight", "name": "osd.5", "weight": 0.0}]': finished 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: osdmap e46: 6 total, 6 up, 6 in 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: osd.5 weight is now 0.0 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["4"]}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["4"]}]: dispatch 2026-02-12T10:54:51.279 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd down", "ids": ["4"]}]: dispatch 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: Health check failed: 1 osds down (OSD_DOWN) 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd down", "ids": ["4"]}]': finished 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: osdmap e47: 6 total, 5 up, 6 in 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: osd.4 now down 2026-02-12T10:54:51.280 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:50 trial049 ceph-mon[22099]: Removing daemon osd.4 from trial157 -- ports [] 2026-02-12T10:54:51.433 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 podman[35421]: 2026-02-12 10:54:51.163231601 +0000 UTC m=+0.190850397 container remove 505f8da0e0128dbf5651a49f54ee35ce960ff56b7af93705436bc9206a04bc1d (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260202) 2026-02-12T10:54:51.433 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 systemd[1]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.4.service: Deactivated successfully. 2026-02-12T10:54:51.433 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 systemd[1]: Stopped Ceph osd.4 for edb480c7-0800-11f1-86ba-d404e6e7d460. 2026-02-12T10:54:51.433 INFO:journalctl@ceph.osd.4.trial157.stdout:Feb 12 10:54:51 trial157 systemd[1]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.4.service: Consumed 1.030s CPU time, 63.2M memory peak. 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: osdmap e48: 6 total, 5 up, 6 in 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: Removing key for osd.4 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth rm", "entity": "osd.4"}]: dispatch 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth rm", "entity": "osd.4"}]': finished 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: Successfully removed osd.4 on trial157 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd purge-actual", "id": 4, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: Cluster is now healthy 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd purge-actual", "id": 4, "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: osdmap e49: 5 total, 5 up, 5 in 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: Successfully purged osd.4 on trial157 2026-02-12T10:54:52.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:52 trial049 ceph-mon[22099]: Zapping devices for osd.4 on trial157 2026-02-12T10:54:52.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-12T10:54:52.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: osdmap e48: 6 total, 5 up, 6 in 2026-02-12T10:54:52.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: Removing key for osd.4 2026-02-12T10:54:52.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth rm", "entity": "osd.4"}]: dispatch 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth rm", "entity": "osd.4"}]': finished 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: Successfully removed osd.4 on trial157 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd purge-actual", "id": 4, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: Health check cleared: OSD_DOWN (was: 1 osds down) 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: Cluster is now healthy 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd purge-actual", "id": 4, "yes_i_really_mean_it": true}]': finished 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: osdmap e49: 5 total, 5 up, 5 in 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: Successfully purged osd.4 on trial157 2026-02-12T10:54:52.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:52 trial028 ceph-mon[21167]: Zapping devices for osd.4 on trial157 2026-02-12T10:54:53.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: osdmap e50: 5 total, 5 up, 5 in 2026-02-12T10:54:53.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: Successfully zapped devices for osd.4 on trial157 2026-02-12T10:54:53.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:53.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:53.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:53.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:53.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:53.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:53 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:53.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: osdmap e50: 5 total, 5 up, 5 in 2026-02-12T10:54:53.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: Successfully zapped devices for osd.4 on trial157 2026-02-12T10:54:53.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:53.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:53.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:53.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:53.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:53.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:53 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: osdmap e51: 5 total, 5 up, 5 in 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: Detected new or changed devices on trial157 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: Removing daemon agent.trial157 from trial157 -- ports [] 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth rm", "entity": "client.agent.trial157"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth rm", "entity": "client.agent.trial157"}]': finished 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:54 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: osdmap e51: 5 total, 5 up, 5 in 2026-02-12T10:54:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: Detected new or changed devices on trial157 2026-02-12T10:54:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:54.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: Removing daemon agent.trial157 from trial157 -- ports [] 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth rm", "entity": "client.agent.trial157"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth rm", "entity": "client.agent.trial157"}]': finished 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:54.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:54 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: Removing key for client.agent.trial157 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: osdmap e52: 5 total, 5 up, 5 in 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:55 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: Removing key for client.agent.trial157 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: osdmap e52: 5 total, 5 up, 5 in 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:54:55.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:55.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:55 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:56.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:56.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: osdmap e53: 5 total, 5 up, 5 in 2026-02-12T10:54:56.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:56.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:56.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:56.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:56.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:56 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: osdmap e53: 5 total, 5 up, 5 in 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:54:56.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:54:56.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:56.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:56 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:54:57.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:57 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:57.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:57 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:57.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:57 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:57.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:57 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:57 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:57.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:57 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:54:58.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:54:58 trial049 ceph-mon[22099]: pgmap v120: 1 pgs: 1 active+clean+wait; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 134 KiB/s, 0 objects/s recovering 2026-02-12T10:54:58.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:54:58 trial028 ceph-mon[21167]: pgmap v120: 1 pgs: 1 active+clean+wait; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 134 KiB/s, 0 objects/s recovering 2026-02-12T10:55:00.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:00 trial049 ceph-mon[22099]: pgmap v121: 1 pgs: 1 active+clean+wait; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-12T10:55:00.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:00 trial028 ceph-mon[21167]: pgmap v121: 1 pgs: 1 active+clean+wait; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-12T10:55:00.679 INFO:teuthology.orchestra.run.trial028.stderr:++ ceph orch ps --hostname trial157 2026-02-12T10:55:00.821 INFO:teuthology.orchestra.run.trial028.stderr:+ HOST_C_DAEMONS='NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-12T10:55:00.821 INFO:teuthology.orchestra.run.trial028.stderr:osd.5 trial157 running (38s) 5s ago 38s 39.1M 42.5G 19.2.3-680-g05b55d19 dcf18b7f874c 09ebeb5d6ac3 ' 2026-02-12T10:55:00.821 INFO:teuthology.orchestra.run.trial028.stderr:+ '[' 'NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-12T10:55:00.821 INFO:teuthology.orchestra.run.trial028.stderr:osd.5 trial157 running (38s) 5s ago 38s 39.1M 42.5G 19.2.3-680-g05b55d19 dcf18b7f874c 09ebeb5d6ac3 ' '!=' 'No daemons reported' ']' 2026-02-12T10:55:00.821 INFO:teuthology.orchestra.run.trial028.stderr:+ sleep 15 2026-02-12T10:55:02.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:02 trial028 ceph-mon[21167]: pgmap v122: 1 pgs: 1 active+clean+wait; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 79 KiB/s, 0 objects/s recovering 2026-02-12T10:55:02.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:02 trial028 ceph-mon[21167]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:55:02.528 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:02 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:55:02.209+0000 7fa8ad6c8640 -1 calc_pg_upmaps abort due to max <= 0 2026-02-12T10:55:02.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:02 trial049 ceph-mon[22099]: pgmap v122: 1 pgs: 1 active+clean+wait; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 79 KiB/s, 0 objects/s recovering 2026-02-12T10:55:02.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:02 trial049 ceph-mon[22099]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:55:04.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:04 trial028 ceph-mon[21167]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-12T10:55:04.880 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:04 trial049 ceph-mon[22099]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 72 KiB/s, 0 objects/s recovering 2026-02-12T10:55:06.683 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:06 trial049 ceph-mon[22099]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 58 KiB/s, 0 objects/s recovering 2026-02-12T10:55:06.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:06 trial028 ceph-mon[21167]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 58 KiB/s, 0 objects/s recovering 2026-02-12T10:55:08.380 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:08 trial049 ceph-mon[22099]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 53 KiB/s, 0 objects/s recovering 2026-02-12T10:55:08.380 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:08 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:08.380 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:08 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:08.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:08 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:08.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:08 trial028 ceph-mon[21167]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail; 53 KiB/s, 0 objects/s recovering 2026-02-12T10:55:08.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:08 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:08.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:08 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:08.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:08 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:10.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:10 trial049 ceph-mon[22099]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:10.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:10 trial028 ceph-mon[21167]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:11.360 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:11.361 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:11.361 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:11 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:11.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:11.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:11.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:11 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:12.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:12 trial028 ceph-mon[21167]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:12.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:12.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:12.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:12 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:12.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:12 trial049 ceph-mon[22099]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:12.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:12 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:12.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:12 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:12.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:12 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:12.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:12 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a[21163]: 2026-02-12T10:55:12.364+0000 7f3533f0d640 -1 mon.a@0(leader).osd e53 definitely_dead 0 2026-02-12T10:55:13.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:13.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:13.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:55:13.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:55:13.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["5"]}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["5"]}]: dispatch 2026-02-12T10:55:13.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:13 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd down", "ids": ["5"]}]: dispatch 2026-02-12T10:55:13.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:13.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:13.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:55:13.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:55:13.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd df", "format": "json"}]: dispatch 2026-02-12T10:55:13.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["5"]}]: dispatch 2026-02-12T10:55:13.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd safe-to-destroy", "ids": ["5"]}]: dispatch 2026-02-12T10:55:13.780 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:13 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd down", "ids": ["5"]}]: dispatch 2026-02-12T10:55:13.934 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:13 trial157 systemd[1]: Stopping Ceph osd.5 for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:55:13.934 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:13 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5[30787]: 2026-02-12T10:55:13.566+0000 7f38c9f8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:55:13.934 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:13 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5[30787]: 2026-02-12T10:55:13.566+0000 7f38c9f8c640 -1 osd.5 53 *** Got signal Terminated *** 2026-02-12T10:55:13.934 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:13 trial157 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5[30787]: 2026-02-12T10:55:13.566+0000 7f38c9f8c640 -1 osd.5 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-12T10:55:14.402 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[42893]: 2026-02-12 10:55:14.094329676 +0000 UTC m=+0.539304041 container died 09ebeb5d6ac37af56b5078cf71f30a94e1110ce70201b467c16eefd5f73cf0d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841) 2026-02-12T10:55:14.402 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[42893]: 2026-02-12 10:55:14.102875109 +0000 UTC m=+0.547849464 container remove 09ebeb5d6ac37af56b5078cf71f30a94e1110ce70201b467c16eefd5f73cf0d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_REF=wip-squid-pr-67199-kefu-1, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841) 2026-02-12T10:55:14.402 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 bash[42893]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5 2026-02-12T10:55:14.403 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[43024]: 2026-02-12 10:55:14.236700001 +0000 UTC m=+0.014303059 container create 78da052ddf97067c4cf8fd2e3c1240728799b46ee40c77ed55f255737eba1209 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.build-date=20260202, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-12T10:55:14.403 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[43024]: 2026-02-12 10:55:14.272872946 +0000 UTC m=+0.050476004 container init 78da052ddf97067c4cf8fd2e3c1240728799b46ee40c77ed55f255737eba1209 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5-deactivate, org.label-schema.build-date=20260202, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841) 2026-02-12T10:55:14.403 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[43024]: 2026-02-12 10:55:14.275266584 +0000 UTC m=+0.052869642 container start 78da052ddf97067c4cf8fd2e3c1240728799b46ee40c77ed55f255737eba1209 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5-deactivate, CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260202, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-12T10:55:14.403 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[43024]: 2026-02-12 10:55:14.275751053 +0000 UTC m=+0.053354111 container attach 78da052ddf97067c4cf8fd2e3c1240728799b46ee40c77ed55f255737eba1209 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5-deactivate, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.build-date=20260202, org.label-schema.vendor=CentOS, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-12T10:55:14.403 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[43024]: 2026-02-12 10:55:14.231038767 +0000 UTC m=+0.008641825 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-12T10:55:14.403 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[43024]: 2026-02-12 10:55:14.397604379 +0000 UTC m=+0.175207437 container died 78da052ddf97067c4cf8fd2e3c1240728799b46ee40c77ed55f255737eba1209 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.license=GPLv2, org.label-schema.build-date=20260202) 2026-02-12T10:55:14.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:14 trial049 ceph-mon[22099]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:14.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:14 trial049 ceph-mon[22099]: Health check failed: 1 osds down (OSD_DOWN) 2026-02-12T10:55:14.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:14 trial049 ceph-mon[22099]: Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2026-02-12T10:55:14.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:14 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd down", "ids": ["5"]}]': finished 2026-02-12T10:55:14.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:14 trial049 ceph-mon[22099]: osdmap e54: 5 total, 4 up, 5 in 2026-02-12T10:55:14.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:14 trial049 ceph-mon[22099]: osd.5 now down 2026-02-12T10:55:14.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:14 trial049 ceph-mon[22099]: Removing daemon osd.5 from trial157 -- ports [] 2026-02-12T10:55:14.683 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 podman[43024]: 2026-02-12 10:55:14.408263194 +0000 UTC m=+0.185866242 container remove 78da052ddf97067c4cf8fd2e3c1240728799b46ee40c77ed55f255737eba1209 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-5-deactivate, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, CEPH_REF=wip-squid-pr-67199-kefu-1, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-12T10:55:14.684 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 systemd[1]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.5.service: Deactivated successfully. 2026-02-12T10:55:14.684 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 systemd[1]: Stopped Ceph osd.5 for edb480c7-0800-11f1-86ba-d404e6e7d460. 2026-02-12T10:55:14.684 INFO:journalctl@ceph.osd.5.trial157.stdout:Feb 12 10:55:14 trial157 systemd[1]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.5.service: Consumed 1.022s CPU time, 66.9M memory peak. 2026-02-12T10:55:14.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:14 trial028 ceph-mon[21167]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:14.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:14 trial028 ceph-mon[21167]: Health check failed: 1 osds down (OSD_DOWN) 2026-02-12T10:55:14.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:14 trial028 ceph-mon[21167]: Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN) 2026-02-12T10:55:14.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:14 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd down", "ids": ["5"]}]': finished 2026-02-12T10:55:14.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:14 trial028 ceph-mon[21167]: osdmap e54: 5 total, 4 up, 5 in 2026-02-12T10:55:14.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:14 trial028 ceph-mon[21167]: osd.5 now down 2026-02-12T10:55:14.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:14 trial028 ceph-mon[21167]: Removing daemon osd.5 from trial157 -- ports [] 2026-02-12T10:55:15.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth rm", "entity": "osd.5"}]: dispatch 2026-02-12T10:55:15.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth rm", "entity": "osd.5"}]': finished 2026-02-12T10:55:15.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd purge-actual", "id": 5, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:55:15.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2026-02-12T10:55:15.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2026-02-12T10:55:15.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: Cluster is now healthy 2026-02-12T10:55:15.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd purge-actual", "id": 5, "yes_i_really_mean_it": true}]': finished 2026-02-12T10:55:15.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:15 trial049 ceph-mon[22099]: osdmap e55: 4 total, 4 up, 4 in 2026-02-12T10:55:15.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth rm", "entity": "osd.5"}]: dispatch 2026-02-12T10:55:15.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "auth rm", "entity": "osd.5"}]': finished 2026-02-12T10:55:15.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd purge-actual", "id": 5, "yes_i_really_mean_it": true}]: dispatch 2026-02-12T10:55:15.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: Health check cleared: OSD_DOWN (was: 1 osds down) 2026-02-12T10:55:15.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: Health check cleared: OSD_HOST_DOWN (was: 1 host (1 osds) down) 2026-02-12T10:55:15.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: Cluster is now healthy 2026-02-12T10:55:15.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd purge-actual", "id": 5, "yes_i_really_mean_it": true}]': finished 2026-02-12T10:55:15.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:15 trial028 ceph-mon[21167]: osdmap e55: 4 total, 4 up, 4 in 2026-02-12T10:55:15.825 INFO:teuthology.orchestra.run.trial028.stderr:++ ceph orch ps --hostname trial157 2026-02-12T10:55:15.969 INFO:teuthology.orchestra.run.trial028.stderr:+ HOST_C_DAEMONS='No daemons reported' 2026-02-12T10:55:15.970 INFO:teuthology.orchestra.run.trial028.stderr:+ '[' 'No daemons reported' '!=' 'No daemons reported' ']' 2026-02-12T10:55:15.970 INFO:teuthology.orchestra.run.trial028.stderr:+ ceph osd getcrushmap -o compiled-crushmap 2026-02-12T10:55:16.101 INFO:teuthology.orchestra.run.trial028.stderr:17 2026-02-12T10:55:16.108 INFO:teuthology.orchestra.run.trial028.stderr:+ crushtool -d compiled-crushmap -o crushmap.txt 2026-02-12T10:55:16.118 INFO:teuthology.orchestra.run.trial028.stderr:++ cat crushmap.txt 2026-02-12T10:55:16.119 INFO:teuthology.orchestra.run.trial028.stderr:+ CRUSH_MAP='# begin crush map 2026-02-12T10:55:16.119 INFO:teuthology.orchestra.run.trial028.stderr:tunable choose_local_tries 0 2026-02-12T10:55:16.119 INFO:teuthology.orchestra.run.trial028.stderr:tunable choose_local_fallback_tries 0 2026-02-12T10:55:16.119 INFO:teuthology.orchestra.run.trial028.stderr:tunable choose_total_tries 50 2026-02-12T10:55:16.119 INFO:teuthology.orchestra.run.trial028.stderr:tunable chooseleaf_descend_once 1 2026-02-12T10:55:16.119 INFO:teuthology.orchestra.run.trial028.stderr:tunable chooseleaf_vary_r 1 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:tunable chooseleaf_stable 1 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:tunable straw_calc_version 1 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:tunable allowed_bucket_algs 54 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:# devices 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:device 0 osd.0 class ssd 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:device 1 osd.1 class ssd 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:device 2 osd.2 class ssd 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:device 3 osd.3 class ssd 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:# types 2026-02-12T10:55:16.120 INFO:teuthology.orchestra.run.trial028.stderr:type 0 osd 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 1 host 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 2 chassis 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 3 rack 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 4 row 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 5 pdu 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 6 pod 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 7 room 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 8 datacenter 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 9 zone 2026-02-12T10:55:16.121 INFO:teuthology.orchestra.run.trial028.stderr:type 10 region 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr:type 11 root 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr:# buckets 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr:host trial028 { 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: id -3 # do not change unnecessarily 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: id -4 class ssd # do not change unnecessarily 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: # weight 1.36719 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: alg straw2 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: hash 0 # rjenkins1 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: item osd.0 weight 0.68359 2026-02-12T10:55:16.122 INFO:teuthology.orchestra.run.trial028.stderr: item osd.1 weight 0.68359 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr:host trial049 { 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: id -5 # do not change unnecessarily 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: id -6 class ssd # do not change unnecessarily 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: # weight 1.36719 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: alg straw2 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: hash 0 # rjenkins1 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: item osd.2 weight 0.68359 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: item osd.3 weight 0.68359 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr:host trial157 { 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: id -7 # do not change unnecessarily 2026-02-12T10:55:16.123 INFO:teuthology.orchestra.run.trial028.stderr: id -8 class ssd # do not change unnecessarily 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: # weight 0.00000 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: alg straw2 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: hash 0 # rjenkins1 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr:root default { 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: id -1 # do not change unnecessarily 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: id -2 class ssd # do not change unnecessarily 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: # weight 2.73438 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: alg straw2 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: hash 0 # rjenkins1 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: item trial028 weight 1.36719 2026-02-12T10:55:16.124 INFO:teuthology.orchestra.run.trial028.stderr: item trial049 weight 1.36719 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: item trial157 weight 0.00000 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr:# rules 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr:rule replicated_rule { 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: id 0 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: type replicated 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: step take default 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: step choose firstn 0 type osd 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: step emit 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:16.125 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:16.126 INFO:teuthology.orchestra.run.trial028.stderr:# end crush map' 2026-02-12T10:55:16.126 INFO:teuthology.orchestra.run.trial028.stderr:+ grep -q trial157 2026-02-12T10:55:16.126 INFO:teuthology.orchestra.run.trial028.stderr:+ ceph orch host rm trial157 --rm-crush-entry 2026-02-12T10:55:16.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:16.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: Removing key for osd.5 2026-02-12T10:55:16.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: Successfully removed osd.5 on trial157 2026-02-12T10:55:16.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: Successfully purged osd.5 on trial157 2026-02-12T10:55:16.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: Zapping devices for osd.5 on trial157 2026-02-12T10:55:16.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:16.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:16.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:16.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:16.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/3351054552' entity='client.admin' cmd=[{"prefix": "osd getcrushmap"}]: dispatch 2026-02-12T10:55:16.632 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:16 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush remove", "name": "trial157"}]: dispatch 2026-02-12T10:55:16.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 136 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-12T10:55:16.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: Removing key for osd.5 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: Successfully removed osd.5 on trial157 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: Successfully purged osd.5 on trial157 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: Zapping devices for osd.5 on trial157 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/3351054552' entity='client.admin' cmd=[{"prefix": "osd getcrushmap"}]: dispatch 2026-02-12T10:55:16.779 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "osd crush remove", "name": "trial157"}]: dispatch 2026-02-12T10:55:16.894 INFO:teuthology.orchestra.run.trial028.stdout:Removed host 'trial157' 2026-02-12T10:55:16.903 INFO:teuthology.orchestra.run.trial028.stderr:+ sleep 30 2026-02-12T10:55:17.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:55:16.889+0000 7fa8a2672640 -1 log_channel(cephadm) log [ERR] : host trial157 `cephadm ceph-volume` failed: Cannot decode JSON: 2026-02-12T10:55:17.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Traceback (most recent call last): 2026-02-12T10:55:17.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1566, in _run_cephadm_json 2026-02-12T10:55:17.279 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: return json.loads(''.join(out)) 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/lib64/python3.9/json/__init__.py", line 346, in loads 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: return _default_decoder.decode(s) 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/lib64/python3.9/json/decoder.py", line 337, in decode 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: obj, end = self.raw_decode(s, idx=_w(s, 0).end()) 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/lib64/python3.9/json/decoder.py", line 355, in raw_decode 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: raise JSONDecodeError("Expecting value", s, err.value) from None 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: 2026-02-12T10:55:16.890+0000 7fa8a9e81640 -1 log_channel(cephadm) log [ERR] : executing refresh((['trial028', 'trial049', 'trial157'],)) failed. 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: Traceback (most recent call last): 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/usr/share/ceph/mgr/cephadm/utils.py", line 97, in do_work 2026-02-12T10:55:17.280 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: return f(*arg) 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 327, in refresh 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: and not self.mgr.inventory.has_label(host, SpecialHostLabels.NO_MEMORY_AUTOTUNE) 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 198, in has_label 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: host = self._get_stored_name(host) 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 135, in _get_stored_name 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: self.assert_host(host) 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 154, in assert_host 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: raise OrchestratorError('host %s does not exist' % host) 2026-02-12T10:55:17.281 INFO:journalctl@ceph.mgr.a.trial028.stdout:Feb 12 10:55:16 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mgr-a[21419]: orchestrator._interface.OrchestratorError: host trial157 does not exist 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: Successfully zapped devices for osd.5 on trial157 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch host rm", "hostname": "trial157", "rm_crush_entry": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: Detected new or changed devices on trial157 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd crush remove", "name": "trial157"}]': finished 2026-02-12T10:55:17.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: osdmap e56: 4 total, 4 up, 4 in 2026-02-12T10:55:17.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:17.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/host.trial157"}]: dispatch 2026-02-12T10:55:17.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/host.trial157"}]': finished 2026-02-12T10:55:17.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:17.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:55:17.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:55:17.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:17 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: Successfully zapped devices for osd.5 on trial157 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "hostname": "trial157", "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch host rm", "hostname": "trial157", "rm_crush_entry": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: Detected new or changed devices on trial157 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix": "osd crush remove", "name": "trial157"}]': finished 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: osdmap e56: 4 total, 4 up, 4 in 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/host.trial157"}]: dispatch 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/host.trial157"}]': finished 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-12T10:55:18.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:17 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:18.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:18 trial049 ceph-mon[22099]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:18.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:18 trial049 ceph-mon[22099]: host trial157 `cephadm ceph-volume` failed: Cannot decode JSON: 2026-02-12T10:55:18.881 INFO:journalctl@ceph.mon.b.trial049.stdout: Traceback (most recent call last): 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1566, in _run_cephadm_json 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: return json.loads(''.join(out)) 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/lib64/python3.9/json/__init__.py", line 346, in loads 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: return _default_decoder.decode(s) 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/lib64/python3.9/json/decoder.py", line 337, in decode 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: obj, end = self.raw_decode(s, idx=_w(s, 0).end()) 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/lib64/python3.9/json/decoder.py", line 355, in raw_decode 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: raise JSONDecodeError("Expecting value", s, err.value) from None 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout: json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) 2026-02-12T10:55:18.882 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:18 trial049 ceph-mon[22099]: Removed host trial157 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:18 trial049 ceph-mon[22099]: executing refresh((['trial028', 'trial049', 'trial157'],)) failed. 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: Traceback (most recent call last): 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/usr/share/ceph/mgr/cephadm/utils.py", line 97, in do_work 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: return f(*arg) 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 327, in refresh 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: and not self.mgr.inventory.has_label(host, SpecialHostLabels.NO_MEMORY_AUTOTUNE) 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 198, in has_label 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: host = self._get_stored_name(host) 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 135, in _get_stored_name 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: self.assert_host(host) 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 154, in assert_host 2026-02-12T10:55:18.883 INFO:journalctl@ceph.mon.b.trial049.stdout: raise OrchestratorError('host %s does not exist' % host) 2026-02-12T10:55:18.884 INFO:journalctl@ceph.mon.b.trial049.stdout: orchestrator._interface.OrchestratorError: host trial157 does not exist 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:18 trial028 ceph-mon[21167]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:18 trial028 ceph-mon[21167]: host trial157 `cephadm ceph-volume` failed: Cannot decode JSON: 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout: Traceback (most recent call last): 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1566, in _run_cephadm_json 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout: return json.loads(''.join(out)) 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/lib64/python3.9/json/__init__.py", line 346, in loads 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout: return _default_decoder.decode(s) 2026-02-12T10:55:19.029 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/lib64/python3.9/json/decoder.py", line 337, in decode 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: obj, end = self.raw_decode(s, idx=_w(s, 0).end()) 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/lib64/python3.9/json/decoder.py", line 355, in raw_decode 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: raise JSONDecodeError("Expecting value", s, err.value) from None 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:18 trial028 ceph-mon[21167]: Removed host trial157 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:18 trial028 ceph-mon[21167]: executing refresh((['trial028', 'trial049', 'trial157'],)) failed. 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: Traceback (most recent call last): 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/usr/share/ceph/mgr/cephadm/utils.py", line 97, in do_work 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: return f(*arg) 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 327, in refresh 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: and not self.mgr.inventory.has_label(host, SpecialHostLabels.NO_MEMORY_AUTOTUNE) 2026-02-12T10:55:19.030 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 198, in has_label 2026-02-12T10:55:19.031 INFO:journalctl@ceph.mon.a.trial028.stdout: host = self._get_stored_name(host) 2026-02-12T10:55:19.031 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 135, in _get_stored_name 2026-02-12T10:55:19.031 INFO:journalctl@ceph.mon.a.trial028.stdout: self.assert_host(host) 2026-02-12T10:55:19.031 INFO:journalctl@ceph.mon.a.trial028.stdout: File "/usr/share/ceph/mgr/cephadm/inventory.py", line 154, in assert_host 2026-02-12T10:55:19.031 INFO:journalctl@ceph.mon.a.trial028.stdout: raise OrchestratorError('host %s does not exist' % host) 2026-02-12T10:55:19.031 INFO:journalctl@ceph.mon.a.trial028.stdout: orchestrator._interface.OrchestratorError: host trial157 does not exist 2026-02-12T10:55:20.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:20 trial049 ceph-mon[22099]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:21.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:20 trial028 ceph-mon[21167]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:22.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:22 trial049 ceph-mon[22099]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:23.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:22 trial028 ceph-mon[21167]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:24.881 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:24 trial049 ceph-mon[22099]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:25.028 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:24 trial028 ceph-mon[21167]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:26.963 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:26 trial028 ceph-mon[21167]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:27.131 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:26 trial049 ceph-mon[22099]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:28.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:28 trial049 ceph-mon[22099]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:28.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:28.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:28.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:28 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:28.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:28 trial028 ceph-mon[21167]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:28.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:28.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:28.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:28 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:30.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:30 trial049 ceph-mon[22099]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:30.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:30 trial028 ceph-mon[21167]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:31.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:31 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:31.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:31 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:31.529 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:31 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:31.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:31 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:31.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:31 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:31.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:31 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:32.381 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:32 trial049 ceph-mon[22099]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:32.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:32 trial028 ceph-mon[21167]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:34.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:34 trial028 ceph-mon[21167]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:34.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:34 trial049 ceph-mon[22099]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:36.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:36 trial028 ceph-mon[21167]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:36.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:36 trial049 ceph-mon[22099]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:38.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:38 trial028 ceph-mon[21167]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:38.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:38 trial049 ceph-mon[22099]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:40.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:40 trial028 ceph-mon[21167]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:40.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:40 trial049 ceph-mon[22099]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:42.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:42 trial028 ceph-mon[21167]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:42.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:42 trial049 ceph-mon[22099]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:44.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:44 trial028 ceph-mon[21167]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:44.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:44 trial049 ceph-mon[22099]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:46.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:46 trial028 ceph-mon[21167]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:46.630 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:46 trial049 ceph-mon[22099]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-12T10:55:46.907 INFO:teuthology.orchestra.run.trial028.stderr:+ ceph osd getcrushmap -o compiled-crushmap 2026-02-12T10:55:47.038 INFO:teuthology.orchestra.run.trial028.stderr:18 2026-02-12T10:55:47.046 INFO:teuthology.orchestra.run.trial028.stderr:+ crushtool -d compiled-crushmap -o crushmap.txt 2026-02-12T10:55:47.057 INFO:teuthology.orchestra.run.trial028.stderr:++ cat crushmap.txt 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:+ CRUSH_MAP='# begin crush map 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:tunable choose_local_tries 0 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:tunable choose_local_fallback_tries 0 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:tunable choose_total_tries 50 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:tunable chooseleaf_descend_once 1 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:tunable chooseleaf_vary_r 1 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:tunable chooseleaf_stable 1 2026-02-12T10:55:47.058 INFO:teuthology.orchestra.run.trial028.stderr:tunable straw_calc_version 1 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:tunable allowed_bucket_algs 54 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:# devices 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:device 0 osd.0 class ssd 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:device 1 osd.1 class ssd 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:device 2 osd.2 class ssd 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:device 3 osd.3 class ssd 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:# types 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:type 0 osd 2026-02-12T10:55:47.059 INFO:teuthology.orchestra.run.trial028.stderr:type 1 host 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 2 chassis 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 3 rack 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 4 row 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 5 pdu 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 6 pod 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 7 room 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 8 datacenter 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 9 zone 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 10 region 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:type 11 root 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:47.060 INFO:teuthology.orchestra.run.trial028.stderr:# buckets 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr:host trial028 { 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: id -3 # do not change unnecessarily 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: id -4 class ssd # do not change unnecessarily 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: # weight 1.36719 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: alg straw2 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: hash 0 # rjenkins1 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: item osd.0 weight 0.68359 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: item osd.1 weight 0.68359 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr:host trial049 { 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: id -5 # do not change unnecessarily 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: id -6 class ssd # do not change unnecessarily 2026-02-12T10:55:47.061 INFO:teuthology.orchestra.run.trial028.stderr: # weight 1.36719 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: alg straw2 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: hash 0 # rjenkins1 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: item osd.2 weight 0.68359 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: item osd.3 weight 0.68359 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr:root default { 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: id -1 # do not change unnecessarily 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: id -2 class ssd # do not change unnecessarily 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: # weight 2.73438 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: alg straw2 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: hash 0 # rjenkins1 2026-02-12T10:55:47.062 INFO:teuthology.orchestra.run.trial028.stderr: item trial028 weight 1.36719 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: item trial049 weight 1.36719 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr:# rules 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr:rule replicated_rule { 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: id 0 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: type replicated 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: step take default 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: step choose firstn 0 type osd 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: step emit 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr:} 2026-02-12T10:55:47.063 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:55:47.064 INFO:teuthology.orchestra.run.trial028.stderr:# end crush map' 2026-02-12T10:55:47.064 INFO:teuthology.orchestra.run.trial028.stderr:+ grep -q trial157 2026-02-12T10:55:47.092 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-12T10:55:47.102 INFO:tasks.cephadm:Teardown begin 2026-02-12T10:55:47.102 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:55:47.130 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:55:47.162 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:55:47.193 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-12T10:55:47.193 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-12T10:55:47.344 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/mon.a/config 2026-02-12T10:55:47.363 INFO:teuthology.orchestra.run.trial028.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-12T10:55:47.378 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-12T10:55:47.379 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-12T10:55:47.379 DEBUG:teuthology.orchestra.run.trial028:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-12T10:55:47.396 DEBUG:teuthology.orchestra.run.trial049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-12T10:55:47.414 DEBUG:teuthology.orchestra.run.trial157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-12T10:55:47.431 INFO:tasks.cephadm:Stopping all daemons... 2026-02-12T10:55:47.432 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-12T10:55:47.432 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a 2026-02-12T10:55:47.480 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:47 trial028 ceph-mon[21167]: from='client.? 10.20.193.28:0/1260361009' entity='client.admin' cmd=[{"prefix": "osd getcrushmap"}]: dispatch 2026-02-12T10:55:47.480 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:47.480 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:47.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:47 trial028 ceph-mon[21167]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:47.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:47 trial049 ceph-mon[22099]: from='client.? 10.20.193.28:0/1260361009' entity='client.admin' cmd=[{"prefix": "osd getcrushmap"}]: dispatch 2026-02-12T10:55:47.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:47.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:47.631 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:47 trial049 ceph-mon[22099]: from='mgr.14150 10.20.193.28:0/2126200059' entity='mgr.a' 2026-02-12T10:55:47.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:47 trial028 systemd[1]: Stopping Ceph mon.a for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:55:47.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a[21163]: 2026-02-12T10:55:47.534+0000 7f3539718640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:55:47.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 12 10:55:47 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-a[21163]: 2026-02-12T10:55:47.534+0000 7f3539718640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2026-02-12T10:55:47.844 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.a.service' 2026-02-12T10:55:47.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:55:47.903 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-12T10:55:47.903 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-12T10:55:47.903 DEBUG:teuthology.orchestra.run.trial049:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.b 2026-02-12T10:55:48.219 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:47 trial049 systemd[1]: Stopping Ceph mon.b for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:55:48.220 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:47 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-b[22095]: 2026-02-12T10:55:47.993+0000 7f1f9251f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:55:48.220 INFO:journalctl@ceph.mon.b.trial049.stdout:Feb 12 10:55:47 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-mon-b[22095]: 2026-02-12T10:55:47.993+0000 7f1f9251f640 -1 mon.b@1(peon) e4 *** Got Signal Terminated *** 2026-02-12T10:55:48.294 DEBUG:teuthology.orchestra.run.trial049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.b.service' 2026-02-12T10:55:48.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:55:48.343 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-12T10:55:48.343 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-12T10:55:48.343 DEBUG:teuthology.orchestra.run.trial157:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.c 2026-02-12T10:55:48.377 DEBUG:teuthology.orchestra.run.trial157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mon.c.service' 2026-02-12T10:55:48.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:55:48.464 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-12T10:55:48.464 INFO:tasks.cephadm.mgr.a:Stopping mgr.a... 2026-02-12T10:55:48.464 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.a 2026-02-12T10:55:48.706 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.a.service' 2026-02-12T10:55:48.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:55:48.758 INFO:tasks.cephadm.mgr.a:Stopped mgr.a 2026-02-12T10:55:48.758 INFO:tasks.cephadm.mgr.b:Stopping mgr.b... 2026-02-12T10:55:48.758 DEBUG:teuthology.orchestra.run.trial049:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.b 2026-02-12T10:55:48.880 INFO:journalctl@ceph.mgr.b.trial049.stdout:Feb 12 10:55:48 trial049 systemd[1]: Stopping Ceph mgr.b for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:55:48.970 DEBUG:teuthology.orchestra.run.trial049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@mgr.b.service' 2026-02-12T10:55:49.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:55:49.016 INFO:tasks.cephadm.mgr.b:Stopped mgr.b 2026-02-12T10:55:49.016 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-12T10:55:49.017 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.0 2026-02-12T10:55:49.528 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:49 trial028 systemd[1]: Stopping Ceph osd.0 for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:55:49.529 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:49 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0[31242]: 2026-02-12T10:55:49.107+0000 7f5633811640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:55:49.529 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:49 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0[31242]: 2026-02-12T10:55:49.107+0000 7f5633811640 -1 osd.0 56 *** Got signal Terminated *** 2026-02-12T10:55:49.529 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:49 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0[31242]: 2026-02-12T10:55:49.107+0000 7f5633811640 -1 osd.0 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-12T10:55:54.779 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 podman[44715]: 2026-02-12 10:55:54.469982353 +0000 UTC m=+5.374719594 container died 127a275d3b0a4cfeafc2fe90228060a8decc03e6e3ad9341ecd6d4e6d0505fd8 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-12T10:55:54.780 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 podman[44715]: 2026-02-12 10:55:54.478784732 +0000 UTC m=+5.383521973 container remove 127a275d3b0a4cfeafc2fe90228060a8decc03e6e3ad9341ecd6d4e6d0505fd8 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-12T10:55:54.780 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 bash[44715]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0 2026-02-12T10:55:54.780 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 podman[44961]: 2026-02-12 10:55:54.615934204 +0000 UTC m=+0.016130893 container create 7d64765ec0cb39e247ca6f4b61ed9c7939062439129aa2fd31b0a21833b85079 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, OSD_FLAVOR=default) 2026-02-12T10:55:54.780 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 podman[44961]: 2026-02-12 10:55:54.650112668 +0000 UTC m=+0.050309366 container init 7d64765ec0cb39e247ca6f4b61ed9c7939062439129aa2fd31b0a21833b85079 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0-deactivate, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-12T10:55:54.780 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 podman[44961]: 2026-02-12 10:55:54.652690195 +0000 UTC m=+0.052886873 container start 7d64765ec0cb39e247ca6f4b61ed9c7939062439129aa2fd31b0a21833b85079 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260202, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-squid-pr-67199-kefu-1, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-12T10:55:54.780 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 podman[44961]: 2026-02-12 10:55:54.653219478 +0000 UTC m=+0.053416166 container attach 7d64765ec0cb39e247ca6f4b61ed9c7939062439129aa2fd31b0a21833b85079 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True) 2026-02-12T10:55:54.781 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 12 10:55:54 trial028 podman[44961]: 2026-02-12 10:55:54.609649671 +0000 UTC m=+0.009846370 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-12T10:55:54.810 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.0.service' 2026-02-12T10:55:54.864 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:55:54.865 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-12T10:55:54.865 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-12T10:55:54.865 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.1 2026-02-12T10:55:55.279 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:55:54 trial028 systemd[1]: Stopping Ceph osd.1 for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:55:55.279 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:55:54 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1[35002]: 2026-02-12T10:55:54.960+0000 7f32ccdb3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:55:55.279 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:55:54 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1[35002]: 2026-02-12T10:55:54.960+0000 7f32ccdb3640 -1 osd.1 56 *** Got signal Terminated *** 2026-02-12T10:55:55.279 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:55:54 trial028 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1[35002]: 2026-02-12T10:55:54.960+0000 7f32ccdb3640 -1 osd.1 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-12T10:56:00.738 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45097]: 2026-02-12 10:56:00.445544362 +0000 UTC m=+5.495288768 container died 3e4a3b651ddc04e6513c8d5e3eaa83229c41d3289ccd392faf18e09ec51448b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-12T10:56:00.738 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45097]: 2026-02-12 10:56:00.454433292 +0000 UTC m=+5.504177708 container remove 3e4a3b651ddc04e6513c8d5e3eaa83229c41d3289ccd392faf18e09ec51448b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, io.buildah.version=1.33.7, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-squid-pr-67199-kefu-1) 2026-02-12T10:56:00.739 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 bash[45097]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1 2026-02-12T10:56:00.739 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45227]: 2026-02-12 10:56:00.578803217 +0000 UTC m=+0.015894072 container create f3efb4b8c1e3163b794e3cde153c9ac966a8c58298903366d7cb0dd4c9811c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1-deactivate, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202, io.buildah.version=1.33.7, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-12T10:56:00.739 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45227]: 2026-02-12 10:56:00.608327796 +0000 UTC m=+0.045418671 container init f3efb4b8c1e3163b794e3cde153c9ac966a8c58298903366d7cb0dd4c9811c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1-deactivate, ceph=True, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-12T10:56:00.739 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45227]: 2026-02-12 10:56:00.610874967 +0000 UTC m=+0.047965822 container start f3efb4b8c1e3163b794e3cde153c9ac966a8c58298903366d7cb0dd4c9811c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-12T10:56:00.739 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45227]: 2026-02-12 10:56:00.611419178 +0000 UTC m=+0.048510053 container attach f3efb4b8c1e3163b794e3cde153c9ac966a8c58298903366d7cb0dd4c9811c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1-deactivate, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-squid-pr-67199-kefu-1, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260202, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-12T10:56:00.739 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45227]: 2026-02-12 10:56:00.572529675 +0000 UTC m=+0.009620540 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-12T10:56:00.739 INFO:journalctl@ceph.osd.1.trial028.stdout:Feb 12 10:56:00 trial028 podman[45227]: 2026-02-12 10:56:00.73464618 +0000 UTC m=+0.171737045 container died f3efb4b8c1e3163b794e3cde153c9ac966a8c58298903366d7cb0dd4c9811c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-squid-pr-67199-kefu-1, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, io.buildah.version=1.33.7) 2026-02-12T10:56:00.767 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.1.service' 2026-02-12T10:56:00.821 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:56:00.821 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-12T10:56:00.822 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-12T10:56:00.822 DEBUG:teuthology.orchestra.run.trial049:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.2 2026-02-12T10:56:01.131 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:00 trial049 systemd[1]: Stopping Ceph osd.2 for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:56:01.131 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:00 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2[27120]: 2026-02-12T10:56:00.914+0000 7f7434004640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:56:01.131 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:00 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2[27120]: 2026-02-12T10:56:00.914+0000 7f7434004640 -1 osd.2 56 *** Got signal Terminated *** 2026-02-12T10:56:01.131 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:00 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2[27120]: 2026-02-12T10:56:00.914+0000 7f7434004640 -1 osd.2 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-12T10:56:06.537 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 podman[34701]: 2026-02-12 10:56:06.258766976 +0000 UTC m=+5.355760544 container died 8e81cc7780da7a6b52c8eadb70f1343c22d255f3d7e20eb9e9b89d64aa1fc6e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2) 2026-02-12T10:56:06.537 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 podman[34701]: 2026-02-12 10:56:06.267194376 +0000 UTC m=+5.364187924 container remove 8e81cc7780da7a6b52c8eadb70f1343c22d255f3d7e20eb9e9b89d64aa1fc6e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260202, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2) 2026-02-12T10:56:06.537 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 bash[34701]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2 2026-02-12T10:56:06.538 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 podman[34832]: 2026-02-12 10:56:06.396783789 +0000 UTC m=+0.015871413 container create 1773f197116334e3b37b92d8a89216ba4ae945914fe39f06b6c416e3d053aa28 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, ceph=True, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260202, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-squid-pr-67199-kefu-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.label-schema.license=GPLv2) 2026-02-12T10:56:06.538 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 podman[34832]: 2026-02-12 10:56:06.426615379 +0000 UTC m=+0.045703003 container init 1773f197116334e3b37b92d8a89216ba4ae945914fe39f06b6c416e3d053aa28 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, io.buildah.version=1.33.7, ceph=True, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260202, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.schema-version=1.0) 2026-02-12T10:56:06.538 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 podman[34832]: 2026-02-12 10:56:06.429097845 +0000 UTC m=+0.048185459 container start 1773f197116334e3b37b92d8a89216ba4ae945914fe39f06b6c416e3d053aa28 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260202, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.vendor=CentOS) 2026-02-12T10:56:06.538 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 podman[34832]: 2026-02-12 10:56:06.429502427 +0000 UTC m=+0.048590051 container attach 1773f197116334e3b37b92d8a89216ba4ae945914fe39f06b6c416e3d053aa28 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-2-deactivate, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.build-date=20260202) 2026-02-12T10:56:06.538 INFO:journalctl@ceph.osd.2.trial049.stdout:Feb 12 10:56:06 trial049 podman[34832]: 2026-02-12 10:56:06.390837362 +0000 UTC m=+0.009924996 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-12T10:56:06.585 DEBUG:teuthology.orchestra.run.trial049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.2.service' 2026-02-12T10:56:06.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:56:06.635 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-12T10:56:06.635 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-12T10:56:06.635 DEBUG:teuthology.orchestra.run.trial049:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.3 2026-02-12T10:56:06.881 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:06 trial049 systemd[1]: Stopping Ceph osd.3 for edb480c7-0800-11f1-86ba-d404e6e7d460... 2026-02-12T10:56:06.881 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:06 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3[30482]: 2026-02-12T10:56:06.726+0000 7f32171e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-12T10:56:06.881 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:06 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3[30482]: 2026-02-12T10:56:06.726+0000 7f32171e0640 -1 osd.3 56 *** Got signal Terminated *** 2026-02-12T10:56:06.881 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:06 trial049 ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3[30482]: 2026-02-12T10:56:06.726+0000 7f32171e0640 -1 osd.3 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-12T10:56:12.381 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 podman[34963]: 2026-02-12 10:56:12.100988461 +0000 UTC m=+5.386726935 container died 337c7de6e07023c59d739afbd324876a13e610323d7589bc325192ac9a3fc62c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, ceph=True, org.label-schema.schema-version=1.0) 2026-02-12T10:56:12.382 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 podman[34963]: 2026-02-12 10:56:12.110519934 +0000 UTC m=+5.396258408 container remove 337c7de6e07023c59d739afbd324876a13e610323d7589bc325192ac9a3fc62c (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, OSD_FLAVOR=default, org.label-schema.build-date=20260202, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-squid-pr-67199-kefu-1, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-12T10:56:12.382 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 bash[34963]: ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3 2026-02-12T10:56:12.382 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 podman[35431]: 2026-02-12 10:56:12.235474609 +0000 UTC m=+0.014020180 container create 06c37cbd9f3b498788b150744df02eea48e6be959f4e787419451a95a2841054 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.build-date=20260202, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-12T10:56:12.382 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 podman[35431]: 2026-02-12 10:56:12.275838543 +0000 UTC m=+0.054384134 container init 06c37cbd9f3b498788b150744df02eea48e6be959f4e787419451a95a2841054 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3-deactivate, CEPH_REF=wip-squid-pr-67199-kefu-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260202, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2026-02-12T10:56:12.382 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 podman[35431]: 2026-02-12 10:56:12.278226173 +0000 UTC m=+0.056771754 container start 06c37cbd9f3b498788b150744df02eea48e6be959f4e787419451a95a2841054 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, CEPH_REF=wip-squid-pr-67199-kefu-1, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260202, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-12T10:56:12.382 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 podman[35431]: 2026-02-12 10:56:12.278634622 +0000 UTC m=+0.057180214 container attach 06c37cbd9f3b498788b150744df02eea48e6be959f4e787419451a95a2841054 (image=quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90, name=ceph-edb480c7-0800-11f1-86ba-d404e6e7d460-osd-3-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20260202, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-squid-pr-67199-kefu-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, CEPH_SHA1=05b55d192f002ad5df41409624b8d176527d0841) 2026-02-12T10:56:12.382 INFO:journalctl@ceph.osd.3.trial049.stdout:Feb 12 10:56:12 trial049 podman[35431]: 2026-02-12 10:56:12.230211663 +0000 UTC m=+0.008757244 image pull dcf18b7f874c07528e18918645117d58092ee3898a6a84686004d4372cfac7d0 quay.ceph.io/ceph-ci/ceph@sha256:91848d200fcaa46368f1434361671ab8b338dc28ae3ecbb8d2a955ab01b6ff90 2026-02-12T10:56:12.435 DEBUG:teuthology.orchestra.run.trial049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.3.service' 2026-02-12T10:56:12.486 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:56:12.486 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-12T10:56:12.486 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-12T10:56:12.487 DEBUG:teuthology.orchestra.run.trial157:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.4 2026-02-12T10:56:12.521 DEBUG:teuthology.orchestra.run.trial157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.4.service' 2026-02-12T10:56:12.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:56:12.605 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-12T10:56:12.605 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-12T10:56:12.605 DEBUG:teuthology.orchestra.run.trial157:> sudo systemctl stop ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.5 2026-02-12T10:56:12.637 DEBUG:teuthology.orchestra.run.trial157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-edb480c7-0800-11f1-86ba-d404e6e7d460@osd.5.service' 2026-02-12T10:56:12.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-12T10:56:12.722 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-12T10:56:12.723 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 --force --keep-logs 2026-02-12T10:56:12.843 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:56:13.955 DEBUG:teuthology.orchestra.run.trial049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 --force --keep-logs 2026-02-12T10:56:14.071 INFO:teuthology.orchestra.run.trial049.stdout:Deleting cluster with fsid: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:56:15.182 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 --force --keep-logs 2026-02-12T10:56:15.296 INFO:teuthology.orchestra.run.trial157.stdout:Deleting cluster with fsid: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:56:15.590 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:56:15.618 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:56:15.646 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-12T10:56:15.673 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-12T10:56:15.676 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial028/crash 2026-02-12T10:56:15.677 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash -- . 2026-02-12T10:56:15.702 INFO:teuthology.orchestra.run.trial028.stderr:tar: /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-12T10:56:15.702 INFO:teuthology.orchestra.run.trial028.stderr:tar: Error is not recoverable: exiting now 2026-02-12T10:56:15.705 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial049/crash 2026-02-12T10:56:15.706 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash -- . 2026-02-12T10:56:15.731 INFO:teuthology.orchestra.run.trial049.stderr:tar: /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-12T10:56:15.731 INFO:teuthology.orchestra.run.trial049.stderr:tar: Error is not recoverable: exiting now 2026-02-12T10:56:15.734 DEBUG:teuthology.misc:Transferring archived files from trial157:/var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial157/crash 2026-02-12T10:56:15.735 DEBUG:teuthology.orchestra.run.trial157:> sudo tar c -f - -C /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash -- . 2026-02-12T10:56:15.761 INFO:teuthology.orchestra.run.trial157.stderr:tar: /var/lib/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-12T10:56:15.761 INFO:teuthology.orchestra.run.trial157.stderr:tar: Error is not recoverable: exiting now 2026-02-12T10:56:15.762 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-12T10:56:15.762 DEBUG:teuthology.orchestra.run.trial028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v MON_DOWN | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v CEPHADM_STRAY_HOST | egrep -v CEPHADM_STRAY_DAEMON | egrep -v CEPHADM_FAILED_DAEMON | head -n 1 2026-02-12T10:56:15.788 INFO:tasks.cephadm:Compressing logs... 2026-02-12T10:56:15.788 DEBUG:teuthology.orchestra.run.trial028:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T10:56:15.832 DEBUG:teuthology.orchestra.run.trial049:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T10:56:15.836 DEBUG:teuthology.orchestra.run.trial157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T10:56:15.855 INFO:teuthology.orchestra.run.trial028.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-12T10:56:15.855 INFO:teuthology.orchestra.run.trial028.stderr:: No such file or directory 2026-02-12T10:56:15.855 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.a.log 2026-02-12T10:56:15.855 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.0.log 2026-02-12T10:56:15.855 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log 2026-02-12T10:56:15.855 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.a.log: /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mgr.a.log 2026-02-12T10:56:15.856 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log 2026-02-12T10:56:15.856 INFO:teuthology.orchestra.run.trial028.stderr: 81.4% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log.gz 2026-02-12T10:56:15.856 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mgr.a.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log 2026-02-12T10:56:15.856 INFO:teuthology.orchestra.run.trial028.stderr: 86.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T10:56:15.856 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.1.log 2026-02-12T10:56:15.856 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log 2026-02-12T10:56:15.857 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.1.log: /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log: 85.0% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log.gz 2026-02-12T10:56:15.857 INFO:teuthology.orchestra.run.trial028.stderr: 90.8% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log.gz 2026-02-12T10:56:15.858 INFO:teuthology.orchestra.run.trial028.stderr: 95.6% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log.gz 2026-02-12T10:56:15.859 INFO:teuthology.orchestra.run.trial049.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2026-02-12T10:56:15.859 INFO:teuthology.orchestra.run.trial049.stderr: --verbose -- /var/log/ceph/cephadm.log 2026-02-12T10:56:15.862 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.2.log 2026-02-12T10:56:15.862 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.3.log 2026-02-12T10:56:15.862 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log 2026-02-12T10:56:15.862 INFO:teuthology.orchestra.run.trial049.stderr: 83.2% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T10:56:15.862 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mgr.b.log 2026-02-12T10:56:15.862 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log 2026-02-12T10:56:15.862 INFO:teuthology.orchestra.run.trial049.stderr: 80.7% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log.gz 2026-02-12T10:56:15.863 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mgr.b.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.b.log 2026-02-12T10:56:15.863 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log 2026-02-12T10:56:15.863 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log 2026-02-12T10:56:15.863 INFO:teuthology.orchestra.run.trial049.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log: /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log: 90.9% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log.gz 2026-02-12T10:56:15.864 INFO:teuthology.orchestra.run.trial049.stderr: 84.9% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log.gz 2026-02-12T10:56:15.864 INFO:teuthology.orchestra.run.trial049.stderr: 90.2% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mgr.b.log.gz 2026-02-12T10:56:15.867 INFO:teuthology.orchestra.run.trial157.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2026-02-12T10:56:15.867 INFO:teuthology.orchestra.run.trial157.stderr: --verbose -- /var/log/ceph/cephadm.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.c.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.5.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.c.log: -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.4.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr: 83.6% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr: 80.4% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.cephadm.log.gz 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr:/var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log: /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log: 83.2% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.log.gz 2026-02-12T10:56:15.868 INFO:teuthology.orchestra.run.trial157.stderr: 90.8% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph.audit.log.gz 2026-02-12T10:56:15.869 INFO:teuthology.orchestra.run.trial157.stderr: 95.5% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log.gz 2026-02-12T10:56:15.869 INFO:teuthology.orchestra.run.trial049.stderr: 95.3% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-volume.log.gz 2026-02-12T10:56:15.873 INFO:teuthology.orchestra.run.trial028.stderr: 93.7% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.1.log.gz 2026-02-12T10:56:15.873 INFO:teuthology.orchestra.run.trial157.stderr: 92.9% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.5.log.gz 2026-02-12T10:56:15.874 INFO:teuthology.orchestra.run.trial157.stderr: 93.0% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.4.log.gz 2026-02-12T10:56:15.875 INFO:teuthology.orchestra.run.trial028.stderr: 93.5% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.0.log.gz 2026-02-12T10:56:15.884 INFO:teuthology.orchestra.run.trial157.stderr: 92.6% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.c.log.gz 2026-02-12T10:56:15.885 INFO:teuthology.orchestra.run.trial049.stderr: 93.1% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.3.log.gz 2026-02-12T10:56:15.886 INFO:teuthology.orchestra.run.trial157.stderr: 2026-02-12T10:56:15.886 INFO:teuthology.orchestra.run.trial157.stderr:real 0m0.032s 2026-02-12T10:56:15.886 INFO:teuthology.orchestra.run.trial157.stderr:user 0m0.055s 2026-02-12T10:56:15.886 INFO:teuthology.orchestra.run.trial157.stderr:sys 0m0.017s 2026-02-12T10:56:15.894 INFO:teuthology.orchestra.run.trial049.stderr: 92.7% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.b.log.gz 2026-02-12T10:56:15.897 INFO:teuthology.orchestra.run.trial028.stderr: 88.8% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mgr.a.log.gz 2026-02-12T10:56:15.898 INFO:teuthology.orchestra.run.trial049.stderr: 93.8% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-osd.2.log.gz 2026-02-12T10:56:15.899 INFO:teuthology.orchestra.run.trial049.stderr: 2026-02-12T10:56:15.899 INFO:teuthology.orchestra.run.trial049.stderr:real 0m0.049s 2026-02-12T10:56:15.899 INFO:teuthology.orchestra.run.trial049.stderr:user 0m0.108s 2026-02-12T10:56:15.899 INFO:teuthology.orchestra.run.trial049.stderr:sys 0m0.019s 2026-02-12T10:56:15.967 INFO:teuthology.orchestra.run.trial028.stderr: 91.7% -- replaced with /var/log/ceph/edb480c7-0800-11f1-86ba-d404e6e7d460/ceph-mon.a.log.gz 2026-02-12T10:56:15.969 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-12T10:56:15.969 INFO:teuthology.orchestra.run.trial028.stderr:real 0m0.124s 2026-02-12T10:56:15.969 INFO:teuthology.orchestra.run.trial028.stderr:user 0m0.196s 2026-02-12T10:56:15.969 INFO:teuthology.orchestra.run.trial028.stderr:sys 0m0.030s 2026-02-12T10:56:15.969 INFO:tasks.cephadm:Archiving logs... 2026-02-12T10:56:15.970 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/log/ceph to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial028/log 2026-02-12T10:56:15.972 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T10:56:16.104 DEBUG:teuthology.misc:Transferring archived files from trial049:/var/log/ceph to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial049/log 2026-02-12T10:56:16.105 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T10:56:16.162 DEBUG:teuthology.misc:Transferring archived files from trial157:/var/log/ceph to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial157/log 2026-02-12T10:56:16.163 DEBUG:teuthology.orchestra.run.trial157:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T10:56:16.209 INFO:tasks.cephadm:Removing cluster... 2026-02-12T10:56:16.209 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 --force 2026-02-12T10:56:16.323 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:56:16.519 DEBUG:teuthology.orchestra.run.trial049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 --force 2026-02-12T10:56:16.633 INFO:teuthology.orchestra.run.trial049.stdout:Deleting cluster with fsid: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:56:16.822 DEBUG:teuthology.orchestra.run.trial157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid edb480c7-0800-11f1-86ba-d404e6e7d460 --force 2026-02-12T10:56:16.938 INFO:teuthology.orchestra.run.trial157.stdout:Deleting cluster with fsid: edb480c7-0800-11f1-86ba-d404e6e7d460 2026-02-12T10:56:17.116 INFO:tasks.cephadm:Removing cephadm ... 2026-02-12T10:56:17.116 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-12T10:56:17.135 DEBUG:teuthology.orchestra.run.trial049:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-12T10:56:17.154 DEBUG:teuthology.orchestra.run.trial157:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-12T10:56:17.171 INFO:tasks.cephadm:Teardown complete 2026-02-12T10:56:17.171 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T10:56:17.182 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T10:56:17.182 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T10:56:17.185 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T10:56:17.196 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T10:56:17.455 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T10:56:17.466 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T10:56:17.466 DEBUG:teuthology.orchestra.run.trial028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:56:17.468 DEBUG:teuthology.orchestra.run.trial049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:56:17.470 DEBUG:teuthology.orchestra.run.trial157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T10:56:17.482 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:56:17.484 INFO:teuthology.orchestra.run.trial049.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:56:17.486 INFO:teuthology.orchestra.run.trial157.stderr:bash: line 1: ntpq: command not found 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial157.stdout:=============================================================================== 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial157.stdout:^- 155.248.196.28 2 6 377 31 -4649us[-4649us] +/- 53ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial157.stdout:^* time.lmtlabs.com 2 6 377 33 +910us[ +958us] +/- 16ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial157.stdout:^+ 50.218.103.254 3 6 377 31 -2157us[-2157us] +/- 34ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial157.stdout:^- dns-e.ns4v.icu 2 6 377 31 -1433us[-1433us] +/- 73ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial028.stdout:^- 155.248.196.28 2 6 377 31 -4541us[-4541us] +/- 53ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial028.stdout:^* time.lmtlabs.com 2 6 377 32 +1241us[+1082us] +/- 16ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial028.stdout:^+ 50.218.103.254 3 6 377 31 -1616us[-1616us] +/- 34ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial028.stdout:^- dns-e.ns4v.icu 2 6 377 31 -1295us[-1295us] +/- 73ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial049.stdout:=============================================================================== 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial049.stdout:^- 155.248.196.28 2 6 377 31 -5430us[-5430us] +/- 53ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial049.stdout:^* time.lmtlabs.com 2 6 377 32 +1128us[+1129us] +/- 17ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial049.stdout:^+ 50.218.103.254 3 6 377 33 -2148us[-2146us] +/- 34ms 2026-02-12T10:56:17.498 INFO:teuthology.orchestra.run.trial049.stdout:^- dns-e.ns4v.icu 2 6 377 31 -1501us[-1501us] +/- 73ms 2026-02-12T10:56:17.499 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T10:56:17.510 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T10:56:17.510 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T10:56:17.525 DEBUG:teuthology.orchestra.run.trial028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T10:56:17.584 DEBUG:teuthology.orchestra.run.trial049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T10:56:17.629 DEBUG:teuthology.orchestra.run.trial157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T10:56:17.674 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-12T10:56:17.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:17.702 DEBUG:teuthology.orchestra.run.trial049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-12T10:56:17.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:17.730 DEBUG:teuthology.orchestra.run.trial157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-12T10:56:17.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:17.761 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T10:56:17.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T10:56:17.809 INFO:teuthology.task.internal:Duration was 370.237736 seconds 2026-02-12T10:56:17.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T10:56:17.825 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T10:56:17.825 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T10:56:17.828 DEBUG:teuthology.orchestra.run.trial049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T10:56:17.831 DEBUG:teuthology.orchestra.run.trial157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T10:56:17.863 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:56:17.865 INFO:teuthology.orchestra.run.trial049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:56:17.868 INFO:teuthology.orchestra.run.trial157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T10:56:18.317 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T10:56:18.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial028.front.sepia.ceph.com 2026-02-12T10:56:18.318 DEBUG:teuthology.orchestra.run.trial028:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T10:56:18.376 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial049.front.sepia.ceph.com 2026-02-12T10:56:18.377 DEBUG:teuthology.orchestra.run.trial049:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T10:56:18.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial157.front.sepia.ceph.com 2026-02-12T10:56:18.397 DEBUG:teuthology.orchestra.run.trial157:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T10:56:18.417 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T10:56:18.418 DEBUG:teuthology.orchestra.run.trial028:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T10:56:18.420 DEBUG:teuthology.orchestra.run.trial049:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T10:56:18.439 DEBUG:teuthology.orchestra.run.trial157:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T10:56:18.523 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T10:56:18.523 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T10:56:18.526 DEBUG:teuthology.orchestra.run.trial049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T10:56:18.529 DEBUG:teuthology.orchestra.run.trial157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T10:56:18.547 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:56:18.547 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:56:18.548 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T10:56:18.548 INFO:teuthology.orchestra.run.trial028.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T10:56:18.549 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T10:56:18.549 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:56:18.550 INFO:teuthology.orchestra.run.trial049.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:56:18.550 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T10:56:18.551 INFO:teuthology.orchestra.run.trial049.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T10:56:18.551 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T10:56:18.552 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T10:56:18.553 INFO:teuthology.orchestra.run.trial157.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T10:56:18.553 INFO:teuthology.orchestra.run.trial157.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T10:56:18.554 INFO:teuthology.orchestra.run.trial157.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T10:56:18.554 INFO:teuthology.orchestra.run.trial157.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T10:56:18.558 INFO:teuthology.orchestra.run.trial049.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T10:56:18.561 INFO:teuthology.orchestra.run.trial157.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T10:56:18.562 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T10:56:18.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T10:56:18.580 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T10:56:18.581 DEBUG:teuthology.orchestra.run.trial028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T10:56:18.630 DEBUG:teuthology.orchestra.run.trial049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T10:56:18.656 DEBUG:teuthology.orchestra.run.trial157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T10:56:18.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T10:56:18.705 DEBUG:teuthology.orchestra.run.trial028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T10:56:18.711 DEBUG:teuthology.orchestra.run.trial049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T10:56:18.715 DEBUG:teuthology.orchestra.run.trial157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T10:56:18.732 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = core 2026-02-12T10:56:18.738 INFO:teuthology.orchestra.run.trial049.stdout:kernel.core_pattern = core 2026-02-12T10:56:18.751 INFO:teuthology.orchestra.run.trial157.stdout:kernel.core_pattern = core 2026-02-12T10:56:18.769 DEBUG:teuthology.orchestra.run.trial028:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T10:56:18.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:18.803 DEBUG:teuthology.orchestra.run.trial049:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T10:56:18.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:18.819 DEBUG:teuthology.orchestra.run.trial157:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T10:56:18.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T10:56:18.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T10:56:18.854 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T10:56:18.855 DEBUG:teuthology.misc:Transferring archived files from trial028:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial028 2026-02-12T10:56:18.855 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T10:56:18.890 DEBUG:teuthology.misc:Transferring archived files from trial049:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial049 2026-02-12T10:56:18.890 DEBUG:teuthology.orchestra.run.trial049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T10:56:18.926 DEBUG:teuthology.misc:Transferring archived files from trial157:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/dgalloway-2026-02-10_16:16:29-rados:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/43325/remote/trial157 2026-02-12T10:56:18.926 DEBUG:teuthology.orchestra.run.trial157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T10:56:18.961 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T10:56:18.961 DEBUG:teuthology.orchestra.run.trial028:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T10:56:18.964 DEBUG:teuthology.orchestra.run.trial049:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T10:56:18.967 DEBUG:teuthology.orchestra.run.trial157:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T10:56:19.011 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T10:56:19.030 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T10:56:19.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T10:56:19.047 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T10:56:19.047 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T10:56:19.050 DEBUG:teuthology.orchestra.run.trial049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T10:56:19.052 DEBUG:teuthology.orchestra.run.trial157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T10:56:19.065 INFO:teuthology.orchestra.run.trial028.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 10:56 /home/ubuntu/cephtest 2026-02-12T10:56:19.067 INFO:teuthology.orchestra.run.trial049.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 10:56 /home/ubuntu/cephtest 2026-02-12T10:56:19.069 INFO:teuthology.orchestra.run.trial157.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 10:56 /home/ubuntu/cephtest 2026-02-12T10:56:19.070 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T10:56:19.087 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T10:56:19.125 INFO:teuthology.run:Summary data: description: rados:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_host_drain} duration: 370.237735748291 flavor: default owner: scheduled_dgalloway@soko04.front.sepia.ceph.com success: true 2026-02-12T10:56:19.125 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T10:56:19.232 INFO:teuthology.run:pass