Found 6 jobs Found 1 distinct failure reasons Dead: b'2020-11-12T10:14:15.825 INFO:teuthology.orchestra.run.smithi125.stdout: "client_addr": "172.21.15.60:0/3393089958",' ceph version 14.2.11-111-gd7199ffce7 (d7199ffce768be466f960ceb42894642b6800bb0) nautilus (stable) 1: (()+0x12980) [0x7f82d4ccc980] 2: (gsignal()+0xc7) [0x7f82d397efb7] 3: (abort()+0x141) [0x7f82d3980921] 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x562e32620d2b] 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x562e32620eb5] 6: (ECBackend::continue_recovery_op(ECBackend::RecoveryOp&, RecoveryMessages*)+0x2acb) [0x562e32a0085b] 7: (ECBackend::run_recovery_op(PGBackend::RecoveryHandle*, int)+0x1065) [0x562e32a0eaa5] 8: (PrimaryLogPG::recover_replicas(unsigned long, ThreadPool::TPHandle&, bool*)+0xe45) [0x562e32843e15] 9: (PrimaryLogPG::start_recovery_ops(unsigned long, ThreadPool::TPHandle&, unsigned long*)+0xf6) [0x562e3286c2d6] 10: (OSD::do_recovery(PG*, unsigned int, unsigned long, ThreadPool::TPHandle&)+0x366) [0x562e326a4e06] 11: (PGRecovery::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x19) [0x562e32969f89] 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf5) [0x562e326c35a5] 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x562e32cf6c9c] 14: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x562e32cf9e60] 15: (()+0x76db) [0x7f82d4cc16db] 16: (clone()+0x3f) [0x7f82d3a6171f] 6 jobs: ['5615679', '5615678', '5615676', '5615675', '5615677', '5615674'] suites intersection: ['ceph.yaml', 'clusters/{fixed-2.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code-overwrites/{bluestore-bitmap.yaml', 'thrashosds-health.yaml'] suites union: ['ceph.yaml', 'clusters/{fixed-2.yaml', 'fast/fast.yaml', 'fast/normal.yaml', 'msgr-failures/fastclose.yaml', 'msgr-failures/few.yaml', 'msgr-failures/osd-delay.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code-overwrites/{bluestore-bitmap.yaml', 'recovery-overrides/{more-async-partial-recovery.yaml}', 'recovery-overrides/{more-async-recovery.yaml}', 'recovery-overrides/{more-partial-recovery.yaml}', 'supported-random-distro$/{centos_latest.yaml}', 'supported-random-distro$/{rhel_latest.yaml}', 'supported-random-distro$/{ubuntu_16.04.yaml}', 'supported-random-distro$/{ubuntu_latest.yaml}', 'thrashers/careful.yaml', 'thrashers/default.yaml', 'thrashers/fastread.yaml', 'thrashers/morepggrow.yaml', 'thrashers/pggrow.yaml', 'thrashosds-health.yaml', 'workloads/ec-pool-snaps-few-objects-overwrites.yaml}', 'workloads/ec-small-objects-fast-read-overwrites.yaml}', 'workloads/ec-small-objects-overwrites.yaml}', 'workloads/ec-snaps-few-objects-overwrites.yaml}']