2021-04-12T19:56:54.146 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-12T19:56:54.150 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-04-12T23:16:30.049 INFO:teuthology.results:Tests finished! gathering results... 2021-04-12T23:17:17.660 INFO:scrape:Found 429 jobs 2021-04-12T23:17:17.665 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/sage-2021-04-12_16:44:22-rados-wip-sage2-testing-2021-04-12-0833-pacific-distro-basic-smithi/6040769/teuthology.log 2021-04-12T23:17:20.920 INFO:scrape:Found 8 distinct failure reasons 2021-04-12T23:17:20.922 INFO:scrape:Dead: None 2021-04-12T23:17:20.923 INFO:scrape:48 jobs 2021-04-12T23:17:20.923 INFO:scrape: 2021-04-12T23:17:20.924 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi198 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=70779ab8ec04b16ed239bb25a6f4654d6e5ec9ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-04-12T23:17:20.924 INFO:scrape:2 jobs: ['6040996', '6041093'] 2021-04-12T23:17:20.925 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'task/test_cephadm}'] 2021-04-12T23:17:20.925 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'task/test_cephadm}'] 2021-04-12T23:17:20.926 INFO:scrape: 2021-04-12T23:17:20.926 INFO:scrape:Failure: Command failed on smithi205 with status 5: 'sudo systemctl stop ceph-72c3da66-9bbe-11eb-81a7-001a4aab830c@mon.smithi205' 2021-04-12T23:17:20.927 INFO:scrape:3 jobs: ['6040971', '6041007', '6041129'] 2021-04-12T23:17:20.927 INFO:scrape:suites intersection: ['1-start', '3-final}'] 2021-04-12T23:17:20.928 INFO:scrape:suites union: ['1-start', '2-services/basic', '2-services/rgw', '3-final}', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable'] 2021-04-12T23:17:20.929 INFO:scrape: 2021-04-12T23:17:20.930 INFO:scrape:Failure: Command failed (workunit test cephtool/test.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=70779ab8ec04b16ed239bb25a6f4654d6e5ec9ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' 2021-04-12T23:17:20.930 INFO:scrape:1 jobs: ['6040796'] 2021-04-12T23:17:20.931 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{centos_8}}'] 2021-04-12T23:17:20.932 INFO:scrape: 2021-04-12T23:17:20.932 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2021-04-12T23:17:20.933 INFO:scrape:1 jobs: ['6040972'] 2021-04-12T23:17:20.933 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{centos_8}', 'tasks/rados_api_tests}'] 2021-04-12T23:17:20.934 INFO:scrape: 2021-04-12T23:17:20.934 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi095 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=70779ab8ec04b16ed239bb25a6f4654d6e5ec9ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-04-12T23:17:20.936 INFO:scrape:1 jobs: ['6040841'] 2021-04-12T23:17:20.936 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/rados_api_tests}'] 2021-04-12T23:17:20.937 INFO:scrape: 2021-04-12T23:17:20.937 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=70779ab8ec04b16ed239bb25a6f4654d6e5ec9ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2021-04-12T23:17:20.938 INFO:scrape:2 jobs: ['6040967', '6041076'] 2021-04-12T23:17:20.939 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'task/test_adoption}'] 2021-04-12T23:17:20.940 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'task/test_adoption}'] 2021-04-12T23:17:20.940 INFO:scrape: 2021-04-12T23:17:20.940 INFO:scrape:Failure: Command failed (workunit test mon/caps.sh) on smithi138 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=70779ab8ec04b16ed239bb25a6f4654d6e5ec9ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' 2021-04-12T23:17:20.941 INFO:scrape:1 jobs: ['6041144'] 2021-04-12T23:17:20.942 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-hybrid', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'thrashers/force-sync-many', 'workloads/rados_mon_workunits}'] 2021-04-12T23:17:20.942 INFO:scrape: