2021-10-22T15:13:22.440 INFO:root:teuthology version: 1.1.0-c56135d1
2021-10-22T15:13:22.443 INFO:teuthology.results:subset: '111/120000'
2021-10-22T15:13:22.443 INFO:teuthology.results:seed: '1550'
2021-10-22T15:14:10.326 INFO:root:teuthology version: 1.1.0-c56135d1
2021-10-22T15:14:10.330 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-10-23T03:15:01.168 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2021-10-23T03:15:03.266 INFO:scrape:Found 23 jobs
2021-10-23T03:15:03.986 INFO:scrape:Found 6 distinct failure reasons
2021-10-23T03:15:03.987 INFO:scrape:Failure: Command failed (workunit test rados/test_dedup_tool.sh) on smithi180 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=822cc122007e25f1e01c9a07e8197bbef272c032 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_dedup_tool.sh'
2021-10-23T03:15:03.987 INFO:scrape:1 jobs: ['6457524']
2021-10-23T03:15:03.988 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'rados', 'rados/singleton/{all/deduptool', 'supported-random-distro$/{centos_8.stream}}']
2021-10-23T03:15:03.988 INFO:scrape:
2021-10-23T03:15:03.989 INFO:scrape:Failure: Command failed on smithi181 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*/2:-*SyntheticMatrixC* --gtest_catch_exceptions=0\''
2021-10-23T03:15:03.989 INFO:scrape:1 jobs: ['6457532']
2021-10-23T03:15:03.990 INFO:scrape:suites: ['rados/objectstore/{backends/objectstore-bluestore-a', 'supported-random-distro$/{rhel_8}}']
2021-10-23T03:15:03.990 INFO:scrape:
2021-10-23T03:15:03.991 INFO:scrape:Failure: Test failure: test_ganesha (unittest.loader._FailedTest)
2021-10-23T03:15:03.991 INFO:scrape:2 jobs: ['6457515', '6457527']
2021-10-23T03:15:03.991 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'tasks/dashboard}']
2021-10-23T03:15:03.992 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-comp-snappy}', 'random-objectstore$/{bluestore-comp-zlib}', 'tasks/dashboard}']
2021-10-23T03:15:03.992 INFO:scrape:
2021-10-23T03:15:03.993 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi039 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=822cc122007e25f1e01c9a07e8197bbef272c032 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2021-10-23T03:15:03.993 INFO:scrape:2 jobs: ['6457534', '6457522']
2021-10-23T03:15:03.993 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'tasks/e2e}']
2021-10-23T03:15:03.994 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{centos_8.2_container_tools_3.0', 'random-objectstore$/{bluestore-hybrid}', 'random-objectstore$/{filestore-xfs}', 'tasks/e2e}']
2021-10-23T03:15:03.994 INFO:scrape:
2021-10-23T03:15:03.995 INFO:scrape:Dead: b'2021-10-23T03:15:03.937 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops'
2021-10-23T03:15:03.995 INFO:scrape:1 jobs: ['6457533']
2021-10-23T03:15:03.996 INFO:scrape:suites: ['cluster/{12-osds', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{rhel_8}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}']
2021-10-23T03:15:03.996 INFO:scrape:
2021-10-23T03:15:03.997 INFO:scrape:Dead: b'2021-10-23T03:15:03.950 INFO:tasks.ceph.osd.0.smithi176.stderr:2021-10-23T03:15:03.946+0000 7fd90d64f700 -1 osd.0 7133 get_health_metrics reporting 65 slow ops, oldest is osd_op(client.4399.0:370 2.4 2:20e5eec1:::benchmark_data_smithi197_34036_object1663:head [read 983040~65536 out=65536b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)'
2021-10-23T03:15:03.997 INFO:scrape:1 jobs: ['6457521']
2021-10-23T03:15:03.997 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/singleton/{all/thrash-eio', 'supported-random-distro$/{centos_8}}']
2021-10-23T03:15:03.998 INFO:scrape: