2022-08-28T17:55:42.236 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-08-28T17:55:42.237 INFO:teuthology.results:seed: '3575'
2022-08-28T17:55:45.120 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-08-28T17:55:45.122 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-08-29T01:25:13.860 INFO:teuthology.results:Tests finished! gathering results...
2022-08-29T01:25:14.039 INFO:scrape:Found 2 jobs
2022-08-29T01:25:14.876 INFO:scrape:Found 2 distinct failure reasons
2022-08-29T01:25:14.877 INFO:scrape:Failure: Command failed on smithi047 with status 1: 'sudo yum -y install ceph-test'
2022-08-29T01:25:14.877 INFO:scrape:1 jobs: ['6997331']
2022-08-29T01:25:14.878 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw:multisite/{clusters', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}']
2022-08-29T01:25:14.878 INFO:scrape:
2022-08-29T01:25:14.879 INFO:scrape:Crash: rgw multisite test failures
2022-08-29T01:25:14.879 INFO:scrape:ceph version 17.0.0-14577-g773e8d30 (773e8d306b197ea38157b609f698e227d36b026b) quincy (dev)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f2f46a57420]
 2: gsignal()
 3: abort()
 4: /lib/x86_64-linux-gnu/libtcmalloc.so.4(+0x141d2) [0x7f2f46cd91d2]
 5: /lib/x86_64-linux-gnu/libtcmalloc.so.4(+0x15ca9) [0x7f2f46cdaca9]
 6: (std::_Rb_tree<rgw_obj_key, std::pair<rgw_obj_key const, RGWSyncShardMarkerTrack<rgw_obj_key, rgw_obj_key>::marker_entry>, std::_Select1st<std::pair<rgw_obj_key const, RGWSyncShardMarkerTrack<rgw_obj_key, rgw_obj_key>::marker_entry> >, std::less<rgw_obj_key>, std::allocator<std::pair<rgw_obj_key const, RGWSyncShardMarkerTrack<rgw_obj_key, rgw_obj_key>::marker_entry> > >::_M_erase_aux(std::_Rb_tree_const_iterator<std::pair<rgw_obj_key const, RGWSyncShardMarkerTrack<rgw_obj_key, rgw_obj_key>::marker_entry> >, std::_Rb_tree_const_iterator<std::pair<rgw_obj_key const, RGWSyncShardMarkerTrack<rgw_obj_key, rgw_obj_key>::marker_entry> >)+0x9a) [0x55b24bb8b54a]
 7: (RGWBucketSyncSingleEntryCR<rgw_obj_key, rgw_obj_key>::operate(DoutPrefixProvider const*)+0x8fe) [0x55b24bbb18ce]
 8: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x17c) [0x55b24bca5ccc]
 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list<RGWCoroutinesStack*, std::allocator<RGWCoroutinesStack*> >&)+0x355) [0x55b24bca7275]
 10: (RGWBucketPipeSyncStatusManager::run(DoutPrefixProvider const*)+0xaca) [0x55b24bb5cb5a]
 11: main()
 12: __libc_start_main()
 13: _start()
2022-08-29T01:25:14.879 INFO:scrape:1 jobs: ['6997332']
2022-08-29T01:25:14.880 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw:multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}']
2022-08-29T01:25:14.880 INFO:scrape: