Found 69 jobs Found 1 distinct failure reasons Crash: "2020-08-27T01:05:23.811046+0000 mon.b (mon.0) 178 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log ceph version 16.0.0-4450-g46640544694 (46640544694606b540ee7ad8129f070971696444) pacific (dev) 1: (()+0x12dc0) [0x7fa11876cdc0] 2: (gsignal()+0x10f) [0x7fa1174428df] 3: (abort()+0x127) [0x7fa11742ccf5] 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x559779c55daf] 5: (()+0x534f78) [0x559779c55f78] 6: (PrimaryLogPG::eval_repop(PrimaryLogPG::RepGather*)+0xbff) [0x559779e6f73f] 7: (PrimaryLogPG::repop_all_committed(PrimaryLogPG::RepGather*)+0x93) [0x559779e6fa83] 8: (Context::complete(int)+0xd) [0x559779d9133d] 9: (ReplicatedBackend::do_repop_reply(boost::intrusive_ptr)+0x1d5) [0x55977a0b5385] 10: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x14f) [0x55977a0c838f] 11: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x559779f34ae2] 12: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x559779ed84ee] 13: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x559779d58279] 14: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x559779fbe6c8] 15: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x12ef) [0x559779d7763f] 16: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55977a3b7844] 17: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55977a3ba4e4] 18: (()+0x82de) [0x7fa1187622de] 19: (clone()+0x43) [0x7fa117507133] 35 jobs suites intersection: ['1-pg-log-overrides/normal_pg_log', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'thrashosds-health'] suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'workloads/small-objects-balanced}', 'workloads/small-objects-localized}', 'workloads/small-objects}']