Found 16 jobs
Found 3 distinct failure reasons
Failure: "2021-02-21 15:27:38.788054 osd.3 (osd.3) 1102 : cluster [ERR] 2.1a deep-scrub : stat mismatch, got 1/1 objects, 0/0 clones, 1/1 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 19/0 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes." in cluster log
1 jobs: ['5891768']
suites: ['1-ceph-install/nautilus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '7-final-workload/{rbd-python', 'objectstore/bluestore-bitmap', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw-swift', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/rhel_7', 'thrashosds-health}', 'upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack']

Failure: failed to recover before timeout expired
4 jobs: ['5891769', '5891754', '5891765', '5891761']
suites intersection: ['1-ceph-install/nautilus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '7-final-workload/{rbd-python', 'objectstore/default', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw-swift', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health}', 'upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack']
suites union: ['1-ceph-install/nautilus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '7-final-workload/{rbd-python', 'objectstore/default', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw-swift', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/centos_latest', 'supported-all-distro/rhel_7', 'supported-all-distro/ubuntu_16.04', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack']

Failure: "2021-02-21 13:49:00.707426 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi118:x (7812), after 300.014 seconds" in cluster log
4 jobs: ['5891763', '5891767', '5891750', '5891758']
suites intersection: ['upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade']
suites union: ['supported-all-distro/centos_latest}', 'supported-all-distro/rhel_7}', 'supported-all-distro/ubuntu_16.04}', 'supported-all-distro/ubuntu_latest}', 'upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade']