Found 42 jobs Found 6 distinct failure reasons Failure: reached maximum tries (90) after waiting for 540 seconds 1 jobs: ['7026945'] suites: ['centos_latest', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/valgrind}'] Dead: b'2022-09-13T06:36:13.733 DEBUG:teuthology.exit:Finished running handlers' ceph version 17.0.0-14883-g10f7d25d (10f7d25d6a0f340676cd251eab5a787ba01ace95) quincy (dev) 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fec9a3c1cf0] 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7fec9b40f523] 3: (tcmalloc::ThreadCache::Scavenge()+0x4e) [0x7fec9b40f86e] 4: (RGWBucketInfo::~RGWBucketInfo()+0x2ba) [0x564bb6ed588a] 5: (RGWAsyncFetchRemoteObj::~RGWAsyncFetchRemoteObj()+0xf9) [0x564bb7113919] 6: (ceph::common::RefCountedObject::put() const+0x1ba) [0x7fec997ed46a] 7: (RGWFetchRemoteObjCR::request_cleanup()+0x64) [0x564bb6fb8564] 8: (RGWSimpleCoroutine::operate(DoutPrefixProvider const*)+0x17c) [0x564bb710070c] 9: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x18f) [0x564bb7100f7f] 10: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x521) [0x564bb7101751] 11: (RGWBucketPipeSyncStatusManager::run(DoutPrefixProvider const*)+0xaca) [0x564bb6fb1baa] 12: main() 13: __libc_start_main() 14: _start() 1 jobs: ['7026931'] suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}', 'tasks/test_multi}'] Failure: Cannot create secret 1 jobs: ['7026926'] suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'supported-random-distro$/{centos_8}}'] Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=10f7d25d6a0f340676cd251eab5a787ba01ace95 1 jobs: ['7026928'] suites: ['hadoop/default', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] Crash: rgw multisite test failures ceph version 17.0.0-14883-g10f7d25d (10f7d25d6a0f340676cd251eab5a787ba01ace95) quincy (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f79a448f420] 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7f79a4723f83] 3: (tcmalloc::ThreadCache::Scavenge()+0x4e) [0x7f79a47242de] 4: (RGWFetchRemoteObjCR::~RGWFetchRemoteObjCR()+0x43) [0x556a1a9be023] 5: (ceph::common::RefCountedObject::put() const+0x121) [0x7f79a39f87a1] 6: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x339) [0x556a1aaf7559] 7: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x355) [0x556a1aaf8945] 8: (RGWBucketPipeSyncStatusManager::run(DoutPrefixProvider const*)+0xaca) [0x556a1a9ae21a] 9: main() 10: __libc_start_main() 11: _start() 1 jobs: ['7026953'] suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] Failure: Command failed on smithi152 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'" 1 jobs: ['7026935'] suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']