2021-07-07T19:39:54.427 INFO:root:teuthology version: 1.1.0-24e3280d
2021-07-07T19:39:54.437 INFO:teuthology.results:subset: '1/2'
2021-07-07T19:39:54.438 INFO:teuthology.results:seed: '4835'
2021-07-07T19:41:10.166 INFO:root:teuthology version: 1.1.0-24e3280d
2021-07-07T19:41:10.204 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-07-07T20:05:12.050 INFO:teuthology.results:Tests finished! gathering results...
2021-07-07T20:05:12.203 INFO:scrape:Found 2 jobs
2021-07-07T20:05:12.572 INFO:scrape:Found 1 distinct failure reasons
2021-07-07T20:05:12.691 INFO:scrape:Crash: 
2021-07-07T20:05:12.692 INFO:scrape:ceph version 17.0.0-5649-g2ce9db4b (2ce9db4b7de13940fbc2ac3ccfd2c99cc9f74c48) quincy (dev)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0) [0x7ff9843703c0]
 2: (RGWBucketSyncPolicyHandler::reflect(RGWBucketSyncFlowManager::pipe_set*, RGWBucketSyncFlowManager::pipe_set*, std::map<rgw_zone_id, RGWBucketSyncFlowManager::pipe_set, std::less<rgw_zone_id>, std::allocator<std::pair<rgw_zone_id const, RGWBucketSyncFlowManager::pipe_set> > >*, std::map<rgw_zone_id, RGWBucketSyncFlowManager::pipe_set, std::less<rgw_zone_id>, std::allocator<std::pair<rgw_zone_id const, RGWBucketSyncFlowManager::pipe_set> > >*, std::set<rgw_zone_id, std::less<rgw_zone_id>, std::allocator<rgw_zone_id> >*, std::set<rgw_zone_id, std::less<rgw_zone_id>, std::allocator<rgw_zone_id> >*, bool) const+0x28d) [0x560a24dfe1bd]
 3: (RGWSI_Zone::do_start(optional_yield, DoutPrefixProvider const*)+0x1f9a) [0x560a24db7cba]
 4: (RGWServiceInstance::start(optional_yield, DoutPrefixProvider const*)+0x20) [0x560a24dc3ee0]
 5: (RGWSI_Notify::do_start(optional_yield, DoutPrefixProvider const*)+0x35) [0x560a253a5e05]
 6: (RGWServiceInstance::start(optional_yield, DoutPrefixProvider const*)+0x20) [0x560a24dc3ee0]
 7: (RGWServices_Def::init(ceph::common::CephContext*, bool, bool, bool, optional_yield, DoutPrefixProvider const*)+0xa68) [0x560a24dc56b8]
 8: (RGWServices::do_init(ceph::common::CephContext*, bool, bool, bool, optional_yield, DoutPrefixProvider const*)+0x26) [0x560a24dc7d66]
 9: (RGWRados::init_svc(bool, DoutPrefixProvider const*)+0x5b) [0x560a250eda6b]
 10: (RGWRados::initialize(DoutPrefixProvider const*)+0x121) [0x560a251419f1]
 11: (StoreManager::init_storage_provider(DoutPrefixProvider const*, ceph::common::CephContext*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, bool, bool, bool, bool, bool, bool)+0xa1) [0x560a25220691]
 12: main()
 13: __libc_start_main()
 14: _start()
2021-07-07T20:05:12.692 INFO:scrape:2 jobs: ['6258030', '6258031']
2021-07-07T20:05:12.692 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'rgw:multisite/{clusters', 'tasks/test_multi}']
2021-07-07T20:05:12.693 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw:multisite/{clusters', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}']
2021-07-07T20:05:12.693 INFO:scrape:
2021-07-07T20:05:12.694 INFO:teuthology.results:Sending results to yehuda@redhat.com: Test Run: yehuda-2021-07-07_12:35:48-rgw:multisite-wip-rgw-realm-resolve-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/yehuda-2021-07-07_12:35:48-rgw:multisite-wip-rgw-realm-resolve-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yehuda-2021-07-07_12:35:48-rgw:multisite-wip-rgw-realm-resolve-distro-basic-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6258030]  rgw:multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{ubuntu_latest} tasks/test_multi}
-----------------------------------------------------------------
time:   00:08:36
info:   http://pulpito.ceph.com/yehuda-2021-07-07_12:35:48-rgw:multisite-wip-rgw-realm-resolve-distro-basic-smithi/6258030/
log:    http://qa-proxy.ceph.com/teuthology/yehuda-2021-07-07_12:35:48-rgw:multisite-wip-rgw-realm-resolve-distro-basic-smithi/6258030/
sentry: https://sentry.ceph.com/organizations/ceph/?query=51dc5984859443a6a4e694dd703b630f

[6258031]  rgw:multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup supported-random-distro$/{rhel_8} tasks/test_multi}
-----------------------------------------------------------------
time:   00:18:18
info:   http://pulpito.ceph.com/yehuda-2021-07-07_12:35:48-rgw:multisite-wip-rgw-realm-resolve-distro-basic-smithi/6258031/
log:    http://qa-proxy.ceph.com/teuthology/yehuda-2021-07-07_12:35:48-rgw:multisite-wip-rgw-realm-resolve-distro-basic-smithi/6258031/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0e818c3b750f4823b238732d43f87a30