Found 80 jobs Found 3 distinct failure reasons Crash: failed to reach quorum size 3 before timeout expired ceph version 14.2.21-288-g045a4d03d5 (045a4d03d58a3af5d7ae689f1612ee4c0594794e) nautilus (stable) 1: (()+0x12980) [0x7fe138dcb980] 2: (gsignal()+0xc7) [0x7fe137ec3fb7] 3: (abort()+0x141) [0x7fe137ec5921] 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7fe139f52543] 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fe139f526cd] 6: (OSDMonitor::update_from_paxos(bool*)+0x3c52) [0x563ee2ea0be2] 7: (PaxosService::refresh(bool*)+0x25a) [0x563ee2e1c54a] 8: (Monitor::refresh_from_paxos(bool*)+0x10c) [0x563ee2cf90fc] 9: (Paxos::do_refresh()+0x4f) [0x563ee2e0b59f] 10: (Paxos::handle_last(boost::intrusive_ptr)+0x8d8) [0x563ee2e15c68] 11: (Paxos::dispatch(boost::intrusive_ptr)+0x24b) [0x563ee2e16a1b] 12: (Monitor::dispatch_op(boost::intrusive_ptr)+0x19ef) [0x563ee2d2d83f] 13: (Monitor::_ms_dispatch(Message*)+0x50a) [0x563ee2d2ddba] 14: (Monitor::ms_dispatch(Message*)+0x26) [0x563ee2d5f356] 15: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x26) [0x563ee2d5b406] 16: (DispatchQueue::entry()+0x1219) [0x7fe13a182c89] 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x7fe13a233efd] 18: (()+0x76db) [0x7fe138dc06db] 19: (clone()+0x3f) [0x7fe137fa671f] 7 jobs: ['6148876', '6148903', '6148922', '6148893', '6148923', '6148914', '6148899'] suites intersection: ['rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{ubuntu_latest}}'] suites union: ['msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'msgr/random', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{ubuntu_latest}}'] Failure: "2021-06-03 05:43:09.087782 osd.0 (osd.0) 1 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running" in cluster log 2 jobs: ['6148873', '6148913'] suites intersection: ['msgr/random', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{rhel_7}}'] suites union: ['msgr-failures/few', 'msgr-failures/many', 'msgr/random', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{rhel_7}}'] Dead: b'2021-06-03T17:36:59.515 DEBUG:teuthology.exit:Finished running handlers' 1 jobs: ['6148878'] suites: ['msgr-failures/many', 'msgr/random', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{rhel_7}}']