2021-01-30T22:35:41.310 INFO:root:teuthology version: 1.0.0-f185165d
2021-01-30T22:35:41.316 INFO:teuthology.results:seed: '2596'
2021-01-30T23:37:22.298 INFO:root:teuthology version: 1.0.0-f185165d
2021-01-30T23:37:22.353 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-01-31T11:32:37.167 INFO:teuthology.results:Tests finished! gathering results...
2021-01-31T11:32:51.589 INFO:scrape:Found 99 jobs
2021-01-31T11:32:53.268 INFO:scrape:Found 5 distinct failure reasons
2021-01-31T11:32:53.269 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi117 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a864dc40115d480e31a77842f8d55bb68e1d8284 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
2021-01-31T11:32:53.269 INFO:scrape:2 jobs: ['5836760', '5836714']
2021-01-31T11:32:53.270 INFO:scrape:suites intersection: ['1-pg-log-overrides/short_pg_log', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'thrashosds-health', 'workloads/rados_api_tests}']
2021-01-31T11:32:53.270 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/normal', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/rados_api_tests}']
2021-01-31T11:32:53.271 INFO:scrape:
2021-01-31T11:32:53.271 INFO:scrape:Timeout 120 running ceph --cluster ceph osd last-stat-seq osd.4
2021-01-31T11:32:53.272 INFO:scrape:1 jobs: ['5836699']
2021-01-31T11:32:53.272 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/fast', 'mon_election/classic', 'msgr-failures/fastclose', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-rados-plugin=clay-k=4-m=2}']
2021-01-31T11:32:53.272 INFO:scrape:
2021-01-31T11:32:53.273 INFO:scrape:Dead: b'2021-01-31T11:29:26.532 DEBUG:teuthology.exit:Finished running handlers'
2021-01-31T11:32:53.273 INFO:scrape:1 jobs: ['5836786']
2021-01-31T11:32:53.274 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/redirect}']
2021-01-31T11:32:53.274 INFO:scrape:
2021-01-31T11:32:53.274 INFO:scrape:Failure: SSH connection to smithi181 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --balance-reads --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0'
2021-01-31T11:32:53.275 INFO:scrape:1 jobs: ['5836724']
2021-01-31T11:32:53.275 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'workloads/snaps-few-objects-balanced}']
2021-01-31T11:32:53.276 INFO:scrape:
2021-01-31T11:32:53.276 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nautilus
2021-01-31T11:32:53.276 INFO:scrape:1 jobs: ['5836704']
2021-01-31T11:32:53.277 INFO:scrape:suites: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'mon_election/classic', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}']
2021-01-31T11:32:53.277 INFO:scrape: