Found 243 jobs
Found 3 distinct failure reasons
Timeout 3h running clone.client.0/qa/workunits/rados/test.sh
1 jobs: ['5228867']
suites: ['1-pg-log-overrides/short_pg_log.yaml', '2-recovery-overrides/{more-async-partial-recovery.yaml}', 'backoff/peering_and_degraded.yaml', 'ceph.yaml', 'clusters/{fixed-2.yaml', 'd-balancer/crush-compat.yaml', 'msgr-failures/osd-delay.yaml', 'msgr/random.yaml', 'objectstore/bluestore-comp-zlib.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml', 'supported-random-distro$/{ubuntu_16.04.yaml}', 'thrashers/default.yaml', 'thrashosds-health.yaml', 'workloads/rados_api_tests.yaml}']

Failure: "2020-07-15 13:28:17.508125 mon.b (mon.1) 9 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log
1 jobs: ['5228874']
suites: ['1-pg-log-overrides/normal_pg_log.yaml', '2-recovery-overrides/{more-async-recovery.yaml}', 'backoff/normal.yaml', 'ceph.yaml', 'clusters/{fixed-2.yaml', 'd-balancer/off.yaml', 'msgr-failures/fastclose.yaml', 'msgr/async-v1only.yaml', 'objectstore/bluestore-comp-zlib.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml', 'supported-random-distro$/{ubuntu_latest.yaml}', 'thrashers/mapgap.yaml', 'thrashosds-health.yaml', 'workloads/small-objects.yaml}']

Failure: reached maximum tries (500) after waiting for 3000 seconds
1 jobs: ['5228923']
suites: ['1-pg-log-overrides/short_pg_log.yaml', '2-recovery-overrides/{more-active-recovery.yaml}', 'backoff/peering.yaml', 'ceph.yaml', 'clusters/{fixed-2.yaml', 'd-balancer/upmap.yaml', 'msgr-failures/few.yaml', 'msgr/simple.yaml', 'objectstore/bluestore-comp-zlib.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml', 'supported-random-distro$/{ubuntu_16.04.yaml}', 'thrashers/mapgap.yaml', 'thrashosds-health.yaml', 'workloads/radosbench.yaml}']