2020-07-15T01:18:54.553 INFO:root:teuthology version: 1.0.0-da68153 2020-07-15T01:18:54.555 INFO:teuthology.results:subset: '457/1577' 2020-07-15T01:18:54.555 INFO:teuthology.results:seed: '2858' 2020-07-15T03:30:57.108 INFO:root:teuthology version: 1.0.0-da68153 2020-07-15T03:30:57.131 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-15T14:29:22.060 INFO:teuthology.results:Tests finished! gathering results... 2020-07-15T14:29:49.874 INFO:scrape:Found 258 jobs 2020-07-15T14:29:54.278 INFO:scrape:Found 3 distinct failure reasons 2020-07-15T14:29:54.280 INFO:scrape:Failure: "2020-07-15 02:50:19.363237 mon.b (mon.0) 12 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log 2020-07-15T14:29:54.280 INFO:scrape:4 jobs: ['5227418', '5227319', '5227472', '5227334'] 2020-07-15T14:29:54.281 INFO:scrape:suites intersection: ['backoff/normal.yaml', 'ceph.yaml', 'clusters/{fixed-2.yaml', 'd-balancer/upmap.yaml', 'msgr-failures/osd-delay.yaml', 'openstack.yaml}', 'rados.yaml', 'thrashosds-health.yaml'] 2020-07-15T14:29:54.281 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log.yaml', '1-pg-log-overrides/short_pg_log.yaml', '2-recovery-overrides/{default.yaml}', '2-recovery-overrides/{more-active-recovery.yaml}', '2-recovery-overrides/{more-async-partial-recovery.yaml}', '2-recovery-overrides/{more-async-recovery.yaml}', 'backoff/normal.yaml', 'ceph.yaml', 'clusters/{fixed-2.yaml', 'd-balancer/upmap.yaml', 'msgr-failures/osd-delay.yaml', 'msgr/async-v1only.yaml', 'msgr/async-v2only.yaml', 'msgr/async.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-stupid.yaml', 'objectstore/filestore-xfs.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml', 'supported-random-distro$/{rhel_latest.yaml}', 'supported-random-distro$/{ubuntu_16.04.yaml}', 'supported-random-distro$/{ubuntu_latest.yaml}', 'thrashers/careful.yaml', 'thrashers/mapgap.yaml', 'thrashers/morepggrow.yaml', 'thrashosds-health.yaml', 'workloads/cache-pool-snaps-readproxy.yaml}', 'workloads/cache.yaml}', 'workloads/small-objects.yaml}'] 2020-07-15T14:29:54.282 INFO:scrape: 2020-07-15T14:29:54.282 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2020-07-15T14:29:54.282 INFO:scrape:1 jobs: ['5227541'] 2020-07-15T14:29:54.283 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log.yaml', '2-recovery-overrides/{more-async-partial-recovery.yaml}', 'backoff/peering_and_degraded.yaml', 'ceph.yaml', 'clusters/{fixed-2.yaml', 'd-balancer/off.yaml', 'msgr-failures/few.yaml', 'msgr/async-v1only.yaml', 'objectstore/bluestore-bitmap.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml', 'supported-random-distro$/{ubuntu_16.04.yaml}', 'thrashers/default.yaml', 'thrashosds-health.yaml', 'workloads/rados_api_tests.yaml}'] 2020-07-15T14:29:54.283 INFO:scrape: 2020-07-15T14:29:54.284 INFO:scrape:Dead: b'2020-07-15T14:26:57.878 DEBUG:teuthology.exit:Finished running handlers' 2020-07-15T14:29:54.284 INFO:scrape:1 jobs: ['5227404'] 2020-07-15T14:29:54.285 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log.yaml', '2-recovery-overrides/{more-async-recovery.yaml}', 'backoff/peering.yaml', 'ceph.yaml', 'clusters/{fixed-2.yaml', 'd-balancer/crush-compat.yaml', 'msgr-failures/fastclose.yaml', 'msgr/async.yaml', 'objectstore/bluestore-bitmap.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml', 'supported-random-distro$/{rhel_latest.yaml}', 'thrashers/default.yaml', 'thrashosds-health.yaml', 'workloads/cache-agent-big.yaml}'] 2020-07-15T14:29:54.285 INFO:scrape: