2022-06-02T08:16:30.170 INFO:root:teuthology version: 1.1.1.dev360+g53fc7fef 2022-06-02T08:16:30.170 INFO:teuthology.results:subset: '1/5' 2022-06-02T08:16:30.170 INFO:teuthology.results:seed: '4881' 2022-06-02T08:39:36.919 INFO:root:teuthology version: 1.1.1.dev360+g53fc7fef 2022-06-02T08:39:36.940 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-02T11:13:54.324 INFO:teuthology.results:Tests finished! gathering results... 2022-06-02T11:14:00.651 INFO:scrape:Found 47 jobs 2022-06-02T11:14:03.164 INFO:scrape:Found 5 distinct failure reasons 2022-06-02T11:14:03.165 INFO:scrape:Crash: Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' 2022-06-02T11:14:03.165 INFO:scrape:ceph version 17.0.0-12690-gbed70513 (bed70513834fdf03dc1eda2ec00ff7b66307af41) quincy (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x143c0) [0x7f1976cf63c0] 2: pthread_mutex_lock() 3: sqlite3_clear_bindings() 4: (SQLiteDB::Reset(DoutPrefixProvider const*, sqlite3_stmt*)+0x15) [0x55a5785666c5] 5: (SQLDeleteStaleObjectData::Execute(DoutPrefixProvider const*, rgw::store::DBOpParams*)+0x2ce) [0x55a5785d581e] 6: (rgw::store::DB::ProcessOp(DoutPrefixProvider const*, std::basic_string_view >, rgw::store::DBOpParams*)+0x2e8) [0x55a57898f3f8] 7: (rgw::store::DB::delete_stale_objs(DoutPrefixProvider const*, std::__cxx11::basic_string, std::allocator > const&, unsigned int)+0x109c) [0x55a5789b53dc] 8: (rgw::store::DB::GC::entry()+0x476) [0x55a5789b6d56] 9: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f1976cea609] 10: clone() 2022-06-02T11:14:03.165 INFO:scrape:1 jobs: ['6858865'] 2022-06-02T11:14:03.165 INFO:scrape:suites: ['overrides', 'rgw/dbstore/{cluster', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rgw_s3tests}'] 2022-06-02T11:14:03.166 INFO:scrape: 2022-06-02T11:14:03.166 INFO:scrape:Failure: rgw multisite test failures 2022-06-02T11:14:03.166 INFO:scrape:2 jobs: ['6858869', '6858894'] 2022-06-02T11:14:03.166 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi}'] 2022-06-02T11:14:03.166 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] 2022-06-02T11:14:03.166 INFO:scrape: 2022-06-02T11:14:03.167 INFO:scrape:Failure: Cannot create secret 2022-06-02T11:14:03.167 INFO:scrape:1 jobs: ['6858864'] 2022-06-02T11:14:03.167 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 'supported-random-distro$/{ubuntu_latest}}'] 2022-06-02T11:14:03.167 INFO:scrape: 2022-06-02T11:14:03.167 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2022-06-02T11:14:03.167 INFO:scrape:1 jobs: ['6858897'] 2022-06-02T11:14:03.168 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/valgrind}'] 2022-06-02T11:14:03.168 INFO:scrape: 2022-06-02T11:14:03.168 INFO:scrape:Failure: Command failed on smithi017 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'" 2022-06-02T11:14:03.168 INFO:scrape:1 jobs: ['6858873'] 2022-06-02T11:14:03.168 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2022-06-02T11:14:03.168 INFO:scrape: