2021-04-30T14:36:01.728 INFO:root:teuthology version: 1.1.0-19220a3b 2021-04-30T14:36:01.729 INFO:teuthology.results:seed: '1810' 2021-05-02T12:24:47.388 INFO:root:teuthology version: 1.1.0-19220a3b 2021-05-02T12:24:47.420 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-05-02T12:24:47.447 INFO:teuthology.results:Tests finished! gathering results... 2021-05-02T12:24:57.629 INFO:scrape:Found 99 jobs 2021-05-02T12:25:01.518 INFO:scrape:Found 4 distinct failure reasons 2021-05-02T12:25:01.519 INFO:scrape:Failure: reached maximum tries (500) after waiting for 3000 seconds 2021-05-02T12:25:01.519 INFO:scrape:6 jobs: ['6083020', '6083046', '6082994', '6082995', '6083045', '6083032'] 2021-05-02T12:25:01.519 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'openstack}', 'rados', 'thrashosds-health'] 2021-05-02T12:25:01.519 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench}'] 2021-05-02T12:25:01.519 INFO:scrape: 2021-05-02T12:25:01.519 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json 2021-05-02T12:25:01.520 INFO:scrape:5 jobs: ['6082983', '6082976', '6083019', '6082999', '6083050'] 2021-05-02T12:25:01.520 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'openstack}', 'rados', 'thrashosds-health'] 2021-05-02T12:25:01.520 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'fast/fast', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/pggrow', 'thrashosds-health', 'workloads/cache-agent-big}', 'workloads/ec-rados-plugin=clay-k=4-m=2}', 'workloads/radosbench-high-concurrency}', 'workloads/set-chunks-read}'] 2021-05-02T12:25:01.520 INFO:scrape: 2021-05-02T12:25:01.520 INFO:scrape:Failure: Command failed on gibba023 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d779cef38ca25e36f5db53b6e27a3a91059dee38' 2021-05-02T12:25:01.520 INFO:scrape:4 jobs: ['6083018', '6083069', '6083044', '6082993'] 2021-05-02T12:25:01.520 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'openstack}', 'rados', 'thrashosds-health', 'workloads/rados_api_tests}'] 2021-05-02T12:25:01.521 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/pggrow', 'thrashosds-health', 'workloads/rados_api_tests}'] 2021-05-02T12:25:01.521 INFO:scrape: 2021-05-02T12:25:01.521 INFO:scrape:Dead: b'2021-05-01T15:30:55.028 DEBUG:teuthology.exit:Finished running handlers' 2021-05-02T12:25:01.521 INFO:scrape:1 jobs: ['6083002'] 2021-05-02T12:25:01.521 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/small-objects}'] 2021-05-02T12:25:01.521 INFO:scrape: