2022-12-12T07:30:01.917 INFO:root:teuthology version: 0.0.1.dev18+g19d18db
2022-12-12T07:30:01.918 INFO:teuthology.results:subset: '655/33888'
2022-12-12T07:30:01.918 INFO:teuthology.results:seed: '7838'
2022-12-12T07:30:57.629 INFO:root:teuthology version: 0.0.1.dev18+g19d18db
2022-12-12T07:30:57.633 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-12-12T10:38:11.197 INFO:teuthology.results:Tests finished! gathering results...
2022-12-12T10:38:13.186 INFO:scrape:Found 29 jobs
2022-12-12T10:38:15.640 INFO:scrape:Found 6 distinct failure reasons
2022-12-12T10:38:15.640 INFO:scrape:Failure: Command failed (workunit test post-file.sh) on smithi032 with status 255: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ff48e026602f3b767fa4a8c277c733a5da4de0d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh'
2022-12-12T10:38:15.641 INFO:scrape:2 jobs: ['7112916', '7112897']
2022-12-12T10:38:15.641 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/ceph-post-file']
2022-12-12T10:38:15.641 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/ceph-post-file', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}']
2022-12-12T10:38:15.641 INFO:scrape:
2022-12-12T10:38:15.641 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ff48e026602f3b767fa4a8c277c733a5da4de0d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
2022-12-12T10:38:15.641 INFO:scrape:1 jobs: ['7112911']
2022-12-12T10:38:15.641 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'thrashers/sync-many', 'workloads/rados_api_tests}']
2022-12-12T10:38:15.642 INFO:scrape:
2022-12-12T10:38:15.642 INFO:scrape:Failure: Command failed on smithi130 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*/2:-*SyntheticMatrixC* --gtest_catch_exceptions=0\''
2022-12-12T10:38:15.642 INFO:scrape:1 jobs: ['7112902']
2022-12-12T10:38:15.642 INFO:scrape:suites: ['rados/objectstore/{backends/objectstore-bluestore-a', 'supported-random-distro$/{ubuntu_latest}}']
2022-12-12T10:38:15.643 INFO:scrape:
2022-12-12T10:38:15.643 INFO:scrape:Failure: Command failed on smithi026 with status 1: 'sudo kubeadm init --node-name smithi026 --token abcdef.2hvhay9jy0dnvnpg --pod-network-cidr 10.248.200.0/21'
2022-12-12T10:38:15.643 INFO:scrape:4 jobs: ['7112895', '7112913', '7112921', '7112904']
2022-12-12T10:38:15.643 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04']
2022-12-12T10:38:15.643 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}']
2022-12-12T10:38:15.643 INFO:scrape:
2022-12-12T10:38:15.643 INFO:scrape:Failure: Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS)
2022-12-12T10:38:15.644 INFO:scrape:2 jobs: ['7112900', '7112917']
2022-12-12T10:38:15.644 INFO:scrape:suites intersection: ['task/test_nfs}']
2022-12-12T10:38:15.644 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_nfs}']
2022-12-12T10:38:15.644 INFO:scrape:
2022-12-12T10:38:15.644 INFO:scrape:Crash: Command failed (workunit test rados/test_crash.sh) on smithi132 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ff48e026602f3b767fa4a8c277c733a5da4de0d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_crash.sh'
2022-12-12T10:38:15.644 INFO:scrape:ceph version 18.0.0-1343-gff48e026 (ff48e026602f3b767fa4a8c277c733a5da4de0d4) reef (dev)
 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f65b9461cf0]
 2: pthread_cond_wait()
 3: (std::condition_variable::wait(std::unique_lock<std::mutex>&)+0x10) [0x7f65b8aa48f0]
 4: (AsyncMessenger::wait()+0x147) [0x557c653741a7]
 5: main()
 6: __libc_start_main()
 7: _start()
2022-12-12T10:38:15.644 INFO:scrape:1 jobs: ['7112893']
2022-12-12T10:38:15.645 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton/{all/test-crash', 'supported-random-distro$/{centos_8}}']
2022-12-12T10:38:15.645 INFO:scrape: