Found 263 jobs
Missing teuthology log /home/teuthworker/archive/nojha-2021-03-25_17:31:39-rados-wip-40323-2-distro-basic-smithi/5998620/teuthology.log
Found 4 distinct failure reasons
Failure: Exiting scrub checking -- not all pgs scrubbed.
1 jobs: ['5998669']
suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/cache-snaps-balanced}']

Dead: None
1 jobs: ['5998620']

Failure: "2021-03-25T19:02:32.435784+0000 mon.a (mon.0) 21 : cluster [WRN] Health check failed: 1/21 mons down, quorum a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t (MON_DOWN)" in cluster log
2 jobs: ['5998525', '5998483']
suites intersection: ['msgr-failures/few', 'rados']
suites union: ['clusters/{fixed-4', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'no_pools', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/multimon/{clusters/21', 'rados/thrash-erasure-code-shec/{ceph', 'recovery-overrides/{default}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_no_skews}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}']

Failure: rgw multisite test failures
1 jobs: ['5998541']
suites: ['frontend', 'overrides', 'rados/upgrade/pacific-x/rgw-multisite/{clusters', 'realm', 'tasks', 'upgrade/primary}']