Found 49 jobs
Found 3 distinct failure reasons
Failure: timeout expired in wait_until_healthy
33 jobs
suites intersection: []
suites union: ['1-ceph-install/nautilus', '1-client', '1-nautilus-install/nautilus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-upgrade', '2-workload/{blogbench', '3-client-upgrade', '3-compat_client/no}}', '3-compat_client/pacific}}', '3-thrash/default', '3-upgrade-sequence/upgrade-all', '3-upgrade-sequence/upgrade-mon-osd-mds', '3-verify}', '3.1-objectstore/bluestore-bitmap', '3.1-objectstore/filestore-xfs', '4-compat_client', '4-ec-workload/{rados-ec-workload', '4-octopus', '4-workload/{radosbench', '5-client-sanity}}', '5-final-workload/{blogbench', '5-finish-upgrade', '6-octopus', '7-final-workload', '7-msgr2', '8-final-workload/{rbd-python', 'clusters/1-mds-2-client-micro', 'conf/{client', 'ec-rados-default', 'mds', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'multimds/no', 'multimds/yes', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'osd}', 'overrides/{frag_enable', 'pg-warn', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd-cls', 'rbd-ec-workload}', 'rbd-import-export', 'rbd_api', 'rbd_cls', 'rbd_import_export', 'readwrite', 'rgw', 'rgw_ragweed_check}', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'tasks/{0-nautilus', 'test_rbd_api', 'test_rbd_python}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap', 'upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap', 'upgrade/cephfs/volumes/import-legacy/{bluestore-bitmap', 'upgrade/nautilus-x/parallel/{0-cluster/{openstack', 'upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack', 'upgrade/nautilus-x/stress-split/{0-cluster/{openstack', 'whitelist_health', 'whitelist_wrongly_marked_down}']

Failure: "2020-10-24T01:21:07.302204+0000 mon.c (mon.0) 24 : cluster [WRN] Health check failed: There are daemons running an older version of ceph (DAEMON_OLD_VERSION)" in cluster log
8 jobs: ['5552333', '5552316', '5552321', '5552291', '5552323', '5552317', '5552297', '5552315']
suites intersection: ['2-partial-upgrade/firsthalf', '3-thrash/default', 'start}', 'thrashosds-health']
suites union: ['1-ceph-install/nautilus', '1-install/nautilus', '1-nautilus-install/nautilus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '3.1-objectstore/bluestore-bitmap', '3.1-objectstore/filestore-xfs', '4-ec-workload/{rados-ec-workload', '4-workload/{radosbench', '4-workload/{rbd-cls', '5-finish-upgrade', '5-workload/{radosbench', '6-finish-upgrade', '6-octopus', '7-final-workload', '7-msgr2', '7-octopus', '8-final-workload/{rbd-python', '8-workload/{rbd-python', 'bluestore-bitmap', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-ec-workload}', 'rbd-import-export', 'rbd_api', 'rbd_api}', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_18.04}', 'ubuntu_latest}', 'upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack', 'upgrade/nautilus-x/stress-split/{0-cluster/{openstack']

Failure: list index out of range
8 jobs: ['5552312', '5552329', '5552298', '5552288', '5552313', '5552322', '5552305', '5552289']
suites intersection: []
suites union: ['upgrade/mimic-x-singleton/mon_election/classic', 'upgrade/mimic-x-singleton/mon_election/connectivity', 'upgrade/mimic-x/parallel/mon_election/classic', 'upgrade/mimic-x/parallel/mon_election/connectivity', 'upgrade/mimic-x/stress-split-erasure-code/mon_election/classic', 'upgrade/mimic-x/stress-split-erasure-code/mon_election/connectivity', 'upgrade/mimic-x/stress-split/mon_election/classic', 'upgrade/mimic-x/stress-split/mon_election/connectivity']