2026-02-13T08:56:25.574 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T08:56:25.574 INFO:teuthology.results:subset: '582/12264' 2026-02-13T08:56:25.574 INFO:teuthology.results:seed: '532' 2026-02-13T09:25:08.420 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T09:25:08.426 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2026-02-13T09:56:10.222 INFO:teuthology.results:Tests finished! gathering results... 2026-02-13T09:56:10.644 INFO:scrape:Found 25 jobs 2026-02-13T09:56:10.644 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:56:07-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48537/teuthology.log 2026-02-13T09:56:10.742 INFO:scrape:Found 5 distinct failure reasons 2026-02-13T09:56:10.742 INFO:scrape:Dead: None 2026-02-13T09:56:10.742 INFO:scrape:1 jobs: ['48537'] 2026-02-13T09:56:10.742 INFO:scrape: 2026-02-13T09:56:10.742 INFO:scrape:Failure: Command failed on trial070 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:03ef619e79a56cd363b087a5c6f19a1a09b49040 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4e202ed-08bc-11f1-8aba-d404e6e7d460 -- bash -c \'set -ex\n# since we don\'"\'"\'t know the real hostnames before the test, the next\n# bit is in order to replace the fake hostnames "host.a/b/c" with\n# the actual names cephadm knows the host by within the mon spec\nceph orch host ls --format json | jq -r \'"\'"\'.[] | .hostname\'"\'"\' > realnames\necho $\'"\'"\'host.a\\nhost.b\\nhost.c\'"\'"\' > fakenames\necho $\'"\'"\'a\\nb\\nc\'"\'"\' > mon_ids\necho $\'"\'"\'{datacenter=a}\\n{datacenter=b,rack=2}\\n{datacenter=a,rack=3}\'"\'"\' > crush_locs\nceph orch ls --service-name mon --export > mon.yaml\nMONSPEC=`cat mon.yaml`\necho "$MONSPEC"\nwhile read realname <&3 && read fakename <&4; do\n MONSPEC="${MONSPEC//$fakename/$realname}"\ndone 3 mon.yaml\ncat mon.yaml\n# now the spec should have the real hostnames, so let\'"\'"\'s re-apply\nceph orch apply -i mon.yaml\nsleep 90\nceph orch ps --refresh\nceph orch ls --service-name mon --export > mon.yaml; ceph orch apply -i mon.yaml\nsleep 90\nceph mon dump\nceph mon dump --format json\n# verify all the crush locations got set from "ceph mon dump" output\nwhile read monid <&3 && read crushloc <&4; do\n ceph mon dump --format json | jq --arg monid "$monid" --arg crushloc "$crushloc" -e \'"\'"\'.mons | .[] | select(.name == $monid) | .crush_location == $crushloc\'"\'"\'\ndone 3, std::allocator > const&, unsigned int, KeyValueDB::IteratorBounds)+0x53f) [0x557e1c30a4df] 4: (BlueStore::_close_db()+0x324) [0x557e1c16f584] 5: (BlueStore::umount()+0x195) [0x557e1c1782f5] 6: ceph-kvstore-tool(+0x20e223) [0x557e1c117223] 7: main() 8: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb17639bd90] 9: __libc_start_main() 10: _start() 2026-02-13T09:56:10.742 INFO:scrape:1 jobs: ['48545'] 2026-02-13T09:56:10.742 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'supported-random-distro$/{ubuntu_latest}}'] 2026-02-13T09:56:10.742 INFO:scrape: 2026-02-13T09:56:10.742 INFO:scrape:Failure: Command failed (workunit test post-file.sh) on trial049 with status 255: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' 2026-02-13T09:56:10.742 INFO:scrape:1 jobs: ['48556'] 2026-02-13T09:56:10.743 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/ceph-post-file', 'supported-random-distro$/{ubuntu_latest}}'] 2026-02-13T09:56:10.743 INFO:scrape: 2026-02-13T09:56:10.743 INFO:scrape:Failure: Command failed (workunit test mon/misc.sh) on trial096 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh' 2026-02-13T09:56:10.743 INFO:scrape:1 jobs: ['48559'] 2026-02-13T09:56:10.743 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_latest}', 'workloads/mon}'] 2026-02-13T09:56:10.743 INFO:scrape: 2026-02-13T09:56:10.743 INFO:teuthology.results:Sending results to akupczyk@ibm.com: Test Run: jayaprakash-2026-02-13_08:56:07-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial ================================================================= info: https://pulpito.ceph.com/jayaprakash-2026-02-13_08:56:07-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/ logs: https://qa-proxy.ceph.com/teuthology/jayaprakash-2026-02-13_08:56:07-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/ failed: 4 dead: 1 running: 0 waiting: 0 queued: 0 passed: 20 Fail ================================================================= [48544] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:07:55 info: https://pulpito.ceph.com/jayaprakash-2026-02-13_08:56:07-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48544/ log: https://qa-proxy.ceph.com/teuthology/jayaprakash-2026-02-13_08:56:07-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48544/ Command failed on trial070 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:03ef619e79a56cd363b087a5c6f19a1a09b49040 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4e202ed-08bc-11f1-8aba-d404e6e7d460 -- bash -c \'set -ex\n# since we don\'"\'"\'t know the real hostnames before the test, the next\n# bit is in order to replace the fake hostnames "host.a/b/c" with\n# the actual names cephadm knows the host by within the mon spec\nceph orch host ls --format json | jq -r \'"\'"\'.[] | .hostname\'"\'"\' > realnames\necho $\'"\'"\'host.a\\nhost.b\\nhost.c\'"\'"\' > fakenames\necho $\'"\'"\'a\\nb\\nc\'"\'"\' > mon_ids\necho $\'"\'"\'{datacenter=a}\\n{datac enter=b,rack=2}\\n{datacenter=a,rack=3}\'"\'"\' > crush_locs\nceph orch ls --service-name mon --export > mon.yaml\nMONSPEC=`cat mon.yaml`\necho "$MONSPEC"\nwhile read realname <&3 && read fakename <&4; do\n MONSPEC="${MONSPEC//$fakename/$realname}"\ndone 3 mon.yaml\ncat mon.yaml\n# now the spec should have the real hostnames, so let\'"\'"\'s re-apply\nceph orch apply -i mon.yaml\nsleep 90\nceph orch ps --refresh\nceph orch ls --service-name mon --export > mon.yaml; ceph orch apply -i mon.yaml\nsleep 90\nceph mon dump\nceph mon dump --format json\n# verify all the crush locations got set from "ceph mon dump" output\nwhile read monid <&3 && read crushloc <&4; do\n ceph mon dump --format json | jq --arg monid "$monid" --arg crushloc "$crushloc" -e \'"\'"\'.mons | .[] | select(.name == $monid) | .crush_location == $crushloc\'"\'"\'\ndone 3