Found 33 jobs Found 2 distinct failure reasons Crash: "2022-06-29T16:35:44.286901+0000 mon.a (mon.0) 210 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log ceph version 17.0.0-13212-g961f7323 (961f7323c4c0c74c15d1e6fb4ddde2c04bbec2b6) quincy (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f4a7c113ce0] 2: (Scrub::ScrubMachine::current_states_desc[abi:cxx11]() const+0x21e) [0x5645e4d0b0ce] 3: (PgScrubber::gen_prefix(std::ostream&) const+0x3d) [0x5645e4ccd5dd] 4: (PgScrubber::update_scrub_stats(std::chrono::time_point > >)+0x274) [0x5645e4ce3ee4] 5: (PG::with_pg_stats(std::chrono::time_point > >, std::function&&)+0x54) [0x5645e4b90bb4] 6: (OSD::collect_pg_stats()+0x6c5) [0x5645e4ad05a5] 7: (MgrClient::_send_pgstats()+0x40) [0x5645e54242d0] 8: (MgrClient::_send_stats()+0x15) [0x5645e5427365] 9: (Context::complete(int)+0xd) [0x5645e4afe1dd] 10: (CommonSafeTimer::timer_thread()+0x11a) [0x5645e51f1f8a] 11: (CommonSafeTimerThread::entry()+0x11) [0x5645e51f35b1] 12: /lib64/libpthread.so.0(+0x81cf) [0x7f4a7c1091cf] 13: clone() 1 jobs: ['6905934'] suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr/async-v1only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/none', 'thrashosds-health', 'workloads/cache-agent-big}'] Failure: {'smithi059.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2 jobs: ['6905961', '6905935'] suites intersection: ['2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'mon_election/classic', 'msgr-failures/fastclose', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/none', 'thrashosds-health', 'workloads/cache-agent-big}'] suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/none', 'thrashosds-health', 'workloads/cache-agent-big}']