2021-08-05T02:19:27.741 INFO:root:teuthology version: 1.1.0-04c2febe
2021-08-05T02:19:27.743 INFO:teuthology.results:subset: '3/4'
2021-08-05T02:19:27.744 INFO:teuthology.results:seed: '2488'
2021-08-05T02:20:06.728 INFO:root:teuthology version: 1.1.0-04c2febe
2021-08-05T02:20:06.734 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-08-05T02:46:08.091 INFO:teuthology.results:Tests finished! gathering results...
2021-08-05T02:46:08.210 INFO:scrape:Found 1 jobs
2021-08-05T02:46:08.326 INFO:scrape:Found 1 distinct failure reasons
2021-08-05T02:46:08.327 INFO:scrape:Crash: reached maximum tries (50) after waiting for 300 seconds
2021-08-05T02:46:08.327 INFO:scrape:ceph version 17.0.0-6593-gede67e63 (ede67e630d11e5f6758fa1e18b166b29d499c421) quincy (dev)
 1: /lib64/libpthread.so.0(+0x12b20) [0x7fddf032db20]
 2: (ProtocolV2::send_message(Message*)+0xa1) [0x7fddf14e0f37]
 3: (AsyncConnection::send_message(Message*)+0x813) [0x7fddf14ad0db]
 4: (Connection::send_message2(boost::intrusive_ptr<Message>)+0x1e) [0x7fddf14ade22]
 5: (MonClient::_send_mon_message(boost::intrusive_ptr<Message>)+0x8a) [0x7fddf1588568]
 6: (MonClient::_finish_hunting(int)+0x5f9) [0x7fddf1593eb5]
 7: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v15_2_0::list const&, CryptoKey*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)+0x2ce) [0x7fddf1595400]
 8: (ProtocolV2::handle_auth_done(ceph::buffer::v15_2_0::list&)+0x4b2) [0x7fddf14f15b4]
 9: (ProtocolV2::handle_frame_payload()+0x1f6) [0x7fddf1500130]
 10: (ProtocolV2::handle_read_frame_dispatch()+0x179) [0x7fddf15003cf]
 11: (ProtocolV2::_handle_read_frame_epilogue_main()+0xc2) [0x7fddf15005e8]
 12: (ProtocolV2::_handle_read_frame_segment()+0xa6) [0x7fddf1500938]
 13: (ProtocolV2::handle_read_frame_segment(std::unique_ptr<ceph::buffer::v15_2_0::ptr_node, ceph::buffer::v15_2_0::ptr_node::disposer>&&, int)+0xc7) [0x7fddf1501f13]
 14: (CtRxNode<ProtocolV2>::call(ProtocolV2*) const+0x31) [0x7fddf1502621]
 15: (ProtocolV2::run_continuation(Ct<ProtocolV2>&)+0x3b) [0x7fddf14e7eaf]
 16: /usr/lib64/ceph/libceph-common.so.2(+0x65d495) [0x7fddf14e8495]
 17: (std::function<void (char*, long)>::operator()(char*, long) const+0x23) [0x7fddf14ae307]
 18: (AsyncConnection::process()+0xeb5) [0x7fddf14ac099]
 19: (C_handle_read::do_request(unsigned long)+0x16) [0x7fddf14aee24]
 20: (EventCenter::process_events(unsigned int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0x594) [0x7fddf150a7a0]
 21: /usr/lib64/ceph/libceph-common.so.2(+0x68a4e7) [0x7fddf15154e7]
 22: (std::function<void ()>::operator()() const+0x12) [0x7fddf1513ba6]
 23: (std::thread::_State_impl<std::thread::_Invoker<std::tuple<std::function<void ()> > > >::_M_run()+0x11) [0x7fddf1513bc1]
 24: /lib64/libstdc++.so.6(+0xc2ba3) [0x7fddef562ba3]
 25: /lib64/libpthread.so.0(+0x814a) [0x7fddf032314a]
 26: clone()
2021-08-05T02:46:08.327 INFO:scrape:1 jobs: ['6311560']
2021-08-05T02:46:08.328 INFO:scrape:suites: ['cephfs-mirror/three-per-cluster', 'clients/{mirror}', 'cluster/{1-node}', 'fs/mirror-ha/{begin', 'mount/fuse', 'objectstore/bluestore-bitmap', 'overrides/{whitelist_health}', 'supported-random-distros$/{centos_8}', 'tasks/mirror}']
2021-08-05T02:46:08.328 INFO:scrape:
2021-08-05T02:46:08.329 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2021-08-05_02:19:15-fs-wip-cephfs-mirror-ha-active-active-20210802-054956-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/vshankar-2021-08-05_02:19:15-fs-wip-cephfs-mirror-ha-active-active-20210802-054956-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/vshankar-2021-08-05_02:19:15-fs-wip-cephfs-mirror-ha-active-active-20210802-054956-distro-basic-smithi/
failed:  1
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6311560]  fs/mirror-ha/{begin cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{centos_8} tasks/mirror}
-----------------------------------------------------------------
time:   00:16:37
info:   http://pulpito.ceph.com/vshankar-2021-08-05_02:19:15-fs-wip-cephfs-mirror-ha-active-active-20210802-054956-distro-basic-smithi/6311560/
log:    http://qa-proxy.ceph.com/teuthology/vshankar-2021-08-05_02:19:15-fs-wip-cephfs-mirror-ha-active-active-20210802-054956-distro-basic-smithi/6311560/

    reached maximum tries (50) after waiting for 300 seconds