Found 71 jobs Found 5 distinct failure reasons Failure: Cannot create secret 1 jobs: ['7013691'] suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'supported-random-distro$/{rhel_8}}'] Dead: b'2022-09-06T17:34:19.688 DEBUG:teuthology.exit:Finished running handlers' ceph version 17.0.0-14816-ge18c72f5 (e18c72f5a292a74f0b36b5712fbcbd1bc05a0e1f) quincy (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f44a6017420] 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7f44a62abf83] 3: (tcmalloc::ThreadCache::Scavenge()+0x4e) [0x7f44a62ac2de] 4: (RGWFetchRemoteObjCR::~RGWFetchRemoteObjCR()+0x43) [0x558fb6d027c3] 5: (ceph::common::RefCountedObject::put() const+0x121) [0x7f44a55807a1] 6: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x339) [0x558fb6e3bcf9] 7: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x355) [0x558fb6e3d0e5] 8: (RGWBucketPipeSyncStatusManager::run(DoutPrefixProvider const*)+0xaca) [0x558fb6cf29ba] 9: main() 10: __libc_start_main() 11: _start() 1 jobs: ['7013696'] suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] Crash: rgw multisite test failures ceph version 17.0.0-14816-ge18c72f5 (e18c72f5a292a74f0b36b5712fbcbd1bc05a0e1f) quincy (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f5952de8420] 2: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned int, int)+0x93) [0x7f595307cf83] 3: (tcmalloc::ThreadCache::Scavenge()+0x4e) [0x7f595307d2de] 4: (ceph::common::RefCountedObject::put() const+0x121) [0x7f59523517a1] 5: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x339) [0x55986119ccf9] 6: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x355) [0x55986119e0e5] 7: (RGWBucketPipeSyncStatusManager::run(DoutPrefixProvider const*)+0xaca) [0x5598610539ba] 8: main() 9: __libc_start_main() 10: _start() 1 jobs: ['7013732'] suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] Failure: Command failed on smithi083 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'" 1 jobs: ['7013700'] suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e18c72f5a292a74f0b36b5712fbcbd1bc05a0e1f 1 jobs: ['7013693'] suites: ['hadoop/default', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}']