Found 71 jobs
Missing teuthology log /home/teuthworker/mnt/teuthology/skanta-2026-02-10_08:28:38-rgw-wip-anrao4-testing-2026-02-09-1228-distro-default-trial/42779/teuthology.log
Missing teuthology log /home/teuthworker/mnt/teuthology/skanta-2026-02-10_08:28:38-rgw-wip-anrao4-testing-2026-02-09-1228-distro-default-trial/42779/teuthology.log
Missing teuthology log /home/teuthworker/mnt/teuthology/skanta-2026-02-10_08:28:38-rgw-wip-anrao4-testing-2026-02-09-1228-distro-default-trial/42778/teuthology.log
Missing teuthology log /home/teuthworker/mnt/teuthology/skanta-2026-02-10_08:28:38-rgw-wip-anrao4-testing-2026-02-09-1228-distro-default-trial/42777/teuthology.log
Missing teuthology log /home/teuthworker/mnt/teuthology/skanta-2026-02-10_08:28:38-rgw-wip-anrao4-testing-2026-02-09-1228-distro-default-trial/42756/teuthology.log
Missing teuthology log /home/teuthworker/mnt/teuthology/skanta-2026-02-10_08:28:38-rgw-wip-anrao4-testing-2026-02-09-1228-distro-default-trial/42754/teuthology.log
Found 20 distinct failure reasons
Failure: Command failed (bucket notification tests against different endpoints) on trial043 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a http_test'
3 jobs: ['42792', '42818', '42763']
suites intersection: ['bluestore-bitmap', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'valgrind}']
suites union: ['bluestore-bitmap', 'centos_latest', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'supported-distros/{centos_latest}', 'supported-distros/{ubuntu_latest}', 'tasks/amqp/{0-install', 'tasks/http/{0-install', 'tasks/kafka_failover/{0-install', 'test_amqp}', 'test_http}', 'test_kafka}', 'valgrind}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7ff75c985bcf]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - RelWithDebInfo)
 1: /lib64/libc.so.6(+0x3fc30) [0x7ff75be3fc30]
 2: /lib64/libc.so.6(+0x8d03c) [0x7ff75be8d03c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7ff75c985bcf]
 6: radosgw-admin() [0x83c5a8]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xfe) [0xedc3fe]
 8: main()
 9: /lib64/libc.so.6(+0x2a610) [0x7ff75be2a610]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42794']
suites: ['accounts$/{main-tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Dead: None
5 jobs: ['42779', '42778', '42777', '42756', '42754']

Failure: No module named 'boto.vendored.six.moves'
5 jobs: ['42797', '42786', '42762', '42809', '42765']
suites intersection: ['frontend/beast', 'ignore-pg-availability', 'overrides']
suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'objectstore/bluestore-bitmap', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'realms/two-zones', 'rgw/multisite/{clusters', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/test_multi}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7fb16a985bcf]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - RelWithDebInfo)
 1: /lib64/libc.so.6(+0x3fc30) [0x7fb169c3fc30]
 2: /lib64/libc.so.6(+0x8d03c) [0x7fb169c8d03c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7fb16a985bcf]
 6: radosgw-admin() [0x83c5a8]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xfe) [0xedc3fe]
 8: main()
 9: /lib64/libc.so.6(+0x2a610) [0x7fb169c2a610]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42816']
suites: ['accounts$/{tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Failure: valgrind error: SyscallParam
__libc_sendmsg
sendmsg

1 jobs: ['42805']
suites: ['bluestore-bitmap', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'supported-distros/{ubuntu_latest}', 'tasks/kafka/{0-install', 'test_kafka}', 'valgrind}']

Failure: Command failed (workunit test rgw/s3_user_quota-run.sh) on trial114 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=356436e231096854bb2454eabaf99f77851e8003 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota-run.sh'
3 jobs: ['42808', '42761', '42785']
suites intersection: ['clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{0-install', 'rgw_multipart_upload', 'rgw_ragweed', 'rgw_s3tests', 'rgw_user_quota}', 's3tests-branch', 'tasks/{rgw_bucket_quota', 'ubuntu_latest}']
suites union: ['clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{0-install', 'rgw_multipart_upload', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'rgw_ragweed', 'rgw_s3tests', 'rgw_user_quota}', 's3tests-branch', 'tasks/{rgw_bucket_quota', 'ubuntu_latest}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f48e7185bcf]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - RelWithDebInfo)
 1: /lib64/libc.so.6(+0x3fc30) [0x7f48e643fc30]
 2: /lib64/libc.so.6(+0x8d03c) [0x7f48e648d03c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f48e7185bcf]
 6: radosgw-admin() [0x83c5a8]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xfe) [0xedc3fe]
 8: main()
 9: /lib64/libc.so.6(+0x2a610) [0x7f48e642a610]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42784']
suites: ['accounts$/{tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f58fd650f1a]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fc969520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f58fd650f1a]
 6: radosgw-admin(+0x60b37d) [0x55cd3314637d]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x102) [0x55cd337cc852]
 8: main()
 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fc950d90]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42821']
suites: ['accounts$/{tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Failure: Failed to reconnect to trial023
1 jobs: ['42772']
suites: ['frontend/beast', 'http', 'ignore-pg-availability', 'overrides', 'rgw/website/{clusters/fixed-2', 's3tests-branch', 'supported-random-distro$/{centos_latest}', 'tasks/s3tests-website}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7fed4c185bcf]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - RelWithDebInfo)
 1: /lib64/libc.so.6(+0x3fc30) [0x7fed4b63fc30]
 2: /lib64/libc.so.6(+0x8d03c) [0x7fed4b68d03c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7fed4c185bcf]
 6: radosgw-admin() [0x83c5a8]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xfe) [0xedc3fe]
 8: main()
 9: /lib64/libc.so.6(+0x2a610) [0x7fed4b62a610]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42812']
suites: ['accounts$/{tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f016f592f1a]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f016e8ab520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f016f592f1a]
 6: radosgw-admin(+0x60b37d) [0x5647ab18037d]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x102) [0x5647ab806852]
 8: main()
 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f016e892d90]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42807']
suites: ['accounts$/{main-tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fef5b6e9f1a]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fef5aa02520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7fef5b6e9f1a]
 6: radosgw-admin(+0x60b37d) [0x563d45ea237d]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x102) [0x563d46528852]
 8: main()
 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fef5a9e9d90]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42776']
suites: ['accounts$/{main}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off-no-gc}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f049ad25f1a]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f049a03e520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f049ad25f1a]
 6: radosgw-admin(+0x60b37d) [0x55cd8d19f37d]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x102) [0x55cd8d825852]
 8: main()
 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f049a025d90]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42802']
suites: ['accounts$/{main}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off-no-gc}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f3a6256bf1a]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3a61884520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f3a6256bf1a]
 6: radosgw-admin(+0x60b37d) [0x55cc4442b37d]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x102) [0x55cc44ab1852]
 8: main()
 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3a6186bd90]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42780']
suites: ['accounts$/{none}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f3857408f1a]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3856721520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x196) [0x7f3857408f1a]
 6: radosgw-admin(+0x60b37d) [0x562caf8e137d]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x102) [0x562caff67852]
 8: main()
 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3856708d90]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42790']
suites: ['accounts$/{none}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Failure: Command failed (ragweed tests against rgw) on trial114 with status 250: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw'"
1 jobs: ['42803']
suites: ['accounts$/{tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/lockdep}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f0152985bcf]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - RelWithDebInfo)
 1: /lib64/libc.so.6(+0x3fc30) [0x7f0151c3fc30]
 2: /lib64/libc.so.6(+0x8d03c) [0x7f0151c8d03c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f0152985bcf]
 6: radosgw-admin() [0x83c5a8]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xfe) [0xedc3fe]
 8: main()
 9: /lib64/libc.so.6(+0x2a610) [0x7f0151c2a610]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42823']
suites: ['accounts$/{main}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f219f985bcf]
ceph version 20.3.0-5162-g356436e2 (356436e231096854bb2454eabaf99f77851e8003) tentacle (dev - RelWithDebInfo)
 1: /lib64/libc.so.6(+0x3fc30) [0x7f219ee3fc30]
 2: /lib64/libc.so.6(+0x8d03c) [0x7f219ee8d03c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f219f985bcf]
 6: radosgw-admin() [0x83c5a8]
 7: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xfe) [0xedc3fe]
 8: main()
 9: /lib64/libc.so.6(+0x2a610) [0x7f219ee2a610]
 10: __libc_start_main()
 11: _start()
1 jobs: ['42773']
suites: ['accounts$/{none}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}']

Failure: Command failed on trial151 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding|.*test_object_expiry.ObjectExpiryTest.test_get_object_after_expiry_time|.*test_object_expiry.ObjectExpiryTest.test_get_object_at_expiry_time|.*test_account_services.AccountTest.test_list_no_account_metadata'"
1 jobs: ['42787']
suites: ['clusters/fixed-1', 'frontend/beast', 'ignore-pg-availability', 'overrides', 'rgw/tempest/{0-install', 's3tests-branch', 'tasks/tempest', 'ubuntu_latest}']