2020-10-31T13:07:52.385 INFO:root:teuthology version: 1.0.0-f7de558 2020-10-31T13:07:52.386 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-01T01:08:04.566 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2020-11-01T01:08:05.160 INFO:scrape:Found 4 jobs 2020-11-01T01:08:05.634 INFO:scrape:Found 1 distinct failure reasons 2020-11-01T01:08:05.634 INFO:scrape:Crash: Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random' 2020-11-01T01:08:05.634 INFO:scrape:ceph version 16.0.0-6700-g527fc06a (527fc06a6fa861e3a8f545461d7a40eebb936742) pacific (dev) 1: /lib64/libpthread.so.0(+0x12dc0) [0x7f562de9adc0] 2: gsignal() 3: abort() 4: radosgw-admin(+0x3a1038) [0x55615fdba038] 5: (RGWSI_SysObj_Core::get_rados_obj(rgw_raw_obj const&, optional_yield)+0x2c5) [0x55615fe37145] 6: (RGWSI_SysObj_Core::read(RGWSysObjectCtxBase&, RGWSI_SysObj_Obj_GetObjState&, RGWObjVersionTracker*, rgw_raw_obj const&, ceph::buffer::v15_2_0::list*, long, long, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, bool, rgw_cache_entry_info*, boost::optional, optional_yield)+0x251) [0x55615fe38321] 7: (RGWSI_SysObj::Obj::ROp::read(long, long, ceph::buffer::v15_2_0::list*, optional_yield)+0x101) [0x55615fe35571] 8: (RGWSI_SysObj::Obj::ROp::read(ceph::buffer::v15_2_0::list*, optional_yield)+0x69) [0x55615fe5a3f9] 9: (RGWSystemMetaObj::read_id(std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator >&)+0x127) [0x556160272877] 10: (RGWSystemMetaObj::init(ceph::common::CephContext*, RGWSI_SysObj*, bool, bool)+0x10c) [0x55616027423c] 11: main() 12: __libc_start_main() 13: _start() 2020-11-01T01:08:05.635 INFO:scrape:4 jobs: ['5567586', '5567588', '5567524', '5567587'] 2020-11-01T01:08:05.635 INFO:scrape:suites intersection: ['overrides'] 2020-11-01T01:08:05.635 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/multifs/{clusters/fixed-2', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/rgw_user_quota}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}'] 2020-11-01T01:08:05.636 INFO:scrape: 2020-11-01T01:08:05.636 INFO:teuthology.results:Sending results to aemerson@redhat.com: Test Run: aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 1 passed: 0 Fail ================================================================= [5567524] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:09:32 info: http://pulpito.ceph.com/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567524/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567524/ sentry: https://sentry.ceph.com/ceph/sepia/?query=16ecf13fcbb8427d8d0a9a76f28ad7b9 Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random' [5567586] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:11:48 info: http://pulpito.ceph.com/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567586/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567586/ sentry: https://sentry.ceph.com/ceph/sepia/?query=ffbaa60082754ad9a78d93b036b053d7 Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random' [5567587] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:05:36 info: http://pulpito.ceph.com/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567587/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567587/ sentry: https://sentry.ceph.com/ceph/sepia/?query=dacb37114f344521befbb4fe3716a7ef Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM' [5567588] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:12:14 info: http://pulpito.ceph.com/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567588/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567588/ sentry: https://sentry.ceph.com/ceph/sepia/?query=5914ee2d281740d6bfaa340836fceefc Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random' Queued ================================================================= [5567585] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} info: http://pulpito.ceph.com/aemerson-2020-10-28_08:38:24-rgw-wip-asyncening-distro-basic-smithi/5567585/