Found 58 jobs Found 5 distinct failure reasons Failure: Command failed on smithi130 with status 1: 'sudo yum -y install ceph-test' 14 jobs: ['6997868', '6997832', '6997838', '6997840', '6997835', '6997884', '6997859', '6997843', '6997875', '6997876', '6997850', '6997839', '6997831', '6997837'] suites intersection: [] suites union: ['1-ceph-install/install', '2-kms/barbican', '2-kms/kmip', '2-kms/vault_old', '3-rgw/rgw', '4-tests/{s3tests}', 'bluestore-bitmap', 'cluster', 'first', 'fixed-2', 'frontend/beast', 'ignore-pg-availability', 'notify', 'objectstore', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'omap_limits', 'overrides', 'pool-type', 'realms/three-zone-plus-pubsub', 'rgw/cloud-transition/{cluster', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/lifecycle/{cluster', 'rgw/multisite/{clusters', 'rgw/notifications/{beast', 'rgw/singleton/{all/radosgw-admin', 'rgw/sts/{cluster', 'rgw/tools/{centos_latest', 'rgw_frontend/beast', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 'ststests}}', 'supported-all-distro$/{centos_8}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'tasks/cloud_transition_s3tests}', 'tasks/rgw_s3tests}', 'tasks/test_multi}', 'tasks/{0-install', 'tasks}', 'test_amqp', 'test_kafka', 'test_others}}'] Failure: Command failed on smithi176 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd' 16 jobs: ['6997877', '6997852', '6997871', '6997882', '6997870', '6997846', '6997886', '6997880', '6997874', '6997861', '6997863', '6997888', '6997855', '6997844', '6997857', '6997849'] suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'tasks/{cls'] suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ceb7b9dfce1e74fc67b8917dc87cca7309b1ff4b 2 jobs: ['6997834', '6997865'] suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] Crash: rgw multisite test failures ceph version 17.0.0-14631-gceb7b9df (ceb7b9dfce1e74fc67b8917dc87cca7309b1ff4b) quincy (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f093005a420] 2: gsignal() 3: abort() 4: /lib/x86_64-linux-gnu/libtcmalloc.so.4(+0x141d2) [0x7f09302dc1d2] 5: /lib/x86_64-linux-gnu/libtcmalloc.so.4(+0x15ca9) [0x7f09302ddca9] 6: (std::_Rb_tree::marker_entry>, std::_Select1st::marker_entry> >, std::less, std::allocator::marker_entry> > >::_M_erase_aux(std::_Rb_tree_const_iterator::marker_entry> >, std::_Rb_tree_const_iterator::marker_entry> >)+0x9a) [0x5565ada4c18a] 7: (RGWBucketSyncSingleEntryCR::operate(DoutPrefixProvider const*)+0x8fe) [0x5565ada7254e] 8: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x17c) [0x5565adb6694c] 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x355) [0x5565adb67ef5] 10: (RGWBucketPipeSyncStatusManager::run(DoutPrefixProvider const*)+0xaca) [0x5565ada1d65a] 11: main() 12: __libc_start_main() 13: _start() 1 jobs: ['6997867'] suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] Failure: Command failed on smithi045 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'" 1 jobs: ['6997841'] suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']