2021-12-28T09:40:27.886 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-28T09:40:27.888 INFO:teuthology.results:seed: '169'
2021-12-28T21:32:50.028 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-28T21:32:50.063 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-12-29T07:36:40.266 INFO:teuthology.results:Tests finished! gathering results...
2021-12-29T07:36:57.979 INFO:scrape:Found 200 jobs
2021-12-29T07:36:58.517 INFO:scrape:Found 6 distinct failure reasons
2021-12-29T07:36:58.518 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh
2021-12-29T07:36:58.518 INFO:scrape:54 jobs
2021-12-29T07:36:58.519 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.520 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.520 INFO:scrape:
2021-12-29T07:36:58.521 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=622be4580cf624746e813aa612e8ee73d9ef0481 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
2021-12-29T07:36:58.521 INFO:scrape:12 jobs: ['6587501', '6587543', '6587540', '6587528', '6587531', '6587557', '6587505', '6587568', '6587495', '6587522', '6587498', '6587608']
2021-12-29T07:36:58.522 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.522 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.523 INFO:scrape:
2021-12-29T07:36:58.524 INFO:scrape:Failure: No module named 'tasks.thrashosds'
2021-12-29T07:36:58.524 INFO:scrape:2 jobs: ['6587418', '6587421']
2021-12-29T07:36:58.525 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.525 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.526 INFO:scrape:
2021-12-29T07:36:58.527 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json
2021-12-29T07:36:58.527 INFO:scrape:2 jobs: ['6587512', '6587564']
2021-12-29T07:36:58.528 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.528 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.528 INFO:scrape:
2021-12-29T07:36:58.529 INFO:scrape:Dead: b'2021-12-29T07:31:03.691 DEBUG:teuthology.exit:Finished running handlers'
2021-12-29T07:36:58.529 INFO:scrape:1 jobs: ['6587578']
2021-12-29T07:36:58.530 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.531 INFO:scrape:
2021-12-29T07:36:58.531 INFO:scrape:Failure: "2021-12-28T12:59:41.687966+0000 mon.a (mon.0) 5143 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log
2021-12-29T07:36:58.532 INFO:scrape:2 jobs: ['6587433', '6587506']
2021-12-29T07:36:58.532 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.533 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2021-12-29T07:36:58.533 INFO:scrape: