2022-03-28T16:24:47.398 INFO:root:teuthology version: 1.1.0-70390753 2022-03-28T16:24:47.399 INFO:teuthology.results:subset: '111/120000' 2022-03-28T16:24:47.399 INFO:teuthology.results:seed: '9566' 2022-03-28T16:49:16.016 INFO:root:teuthology version: 1.1.0-70390753 2022-03-28T16:49:16.021 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-28T21:39:36.433 INFO:teuthology.results:Tests finished! gathering results... 2022-03-28T21:39:37.367 INFO:scrape:Found 13 jobs 2022-03-28T21:39:40.199 INFO:scrape:Found 4 distinct failure reasons 2022-03-28T21:39:40.200 INFO:scrape:Failure: Command failed on smithi204 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludemovqniaq -r -- '-g auto -g blockdev -x clone'" 2022-03-28T21:39:40.201 INFO:scrape:2 jobs: ['6765534', '6765527'] 2022-03-28T21:39:40.203 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2022-03-28T21:39:40.204 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'ms_mode$/{crc}', 'ms_mode$/{legacy}', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2022-03-28T21:39:40.204 INFO:scrape: 2022-03-28T21:39:40.205 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh 2022-03-28T21:39:40.205 INFO:scrape:1 jobs: ['6765531'] 2022-03-28T21:39:40.206 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc$/{crc-rxbounce}', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2022-03-28T21:39:40.206 INFO:scrape: 2022-03-28T21:39:40.207 INFO:scrape:Failure: "2022-03-28T17:06:54.004694+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-03-28T21:39:40.207 INFO:scrape:5 jobs: ['6765532', '6765524', '6765526', '6765529', '6765522'] 2022-03-28T21:39:40.208 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf'] 2022-03-28T21:39:40.208 INFO:scrape:suites union: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'krbd/wac/wac/{bluestore-bitmap', 'ms_mode/legacy$/{legacy-rxbounce}', 'ms_mode/legacy$/{legacy}', 'ms_mode/secure', 'msgr-failures/many', 'tasks/krbd_fallocate}', 'tasks/krbd_udev_enumerate}', 'tasks/rbd_fio}', 'tasks/rbd_kernel}', 'tasks/wac', 'verify/many-resets}'] 2022-03-28T21:39:40.209 INFO:scrape: 2022-03-28T21:39:40.209 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major 2022-03-28T21:39:40.210 INFO:scrape:1 jobs: ['6765528'] 2022-03-28T21:39:40.210 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'filestore-xfs', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}'] 2022-03-28T21:39:40.211 INFO:scrape: