2026-02-12T15:34:56.866 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T15:34:56.866 INFO:teuthology.results:subset: '111/120000' 2026-02-12T15:34:56.866 INFO:teuthology.results:seed: '6315' 2026-02-12T15:35:55.287 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T15:35:55.287 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2026-02-13T03:36:41.653 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2026-02-13T03:36:42.847 INFO:scrape:Found 45 jobs 2026-02-13T03:36:44.323 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46223/teuthology.log 2026-02-13T03:36:44.323 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46223/teuthology.log 2026-02-13T03:36:48.904 INFO:scrape:Found 11 distinct failure reasons 2026-02-13T03:36:48.904 INFO:scrape:Failure: Command failed (s3 tests against rgw) on trial149 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" 2026-02-13T03:36:48.904 INFO:scrape:16 jobs: ['46197', '46227', '46230', '46222', '46214', '46213', '46208', '46200', '46232', '46219', '46234', '46202', '46226', '46207', '46195', '46238'] 2026-02-13T03:36:48.904 INFO:scrape:suites intersection: ['ignore-pg-availability', 's3tests-branch'] 2026-02-13T03:36:48.904 INFO:scrape:suites union: ['1-ceph-install/install', '1-keycloak', '2-kms/barbican', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_old', '2-kms/vault_transit', '2-s3tests}}', '3-rgw/rgw', '4-tests/{s3tests}', 'beast', 'cluster', 'clusters/fixed-1', 'clusters/fixed-2', 'fixed-1', 'frontend/beast', 'http', 'ignore-pg-availability', 'install', 'objectstore', 'objectstore/bluestore-bitmap', 'overrides', 'pool-type', 'rgw/bucket-logging/{0-install', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/lifecycle/{cluster', 'rgw/multifs/{0-install', 'rgw/sts/{auth-order/local-sts', 'rgw/sts/{auth-order/sts-local', 'rgw/tempest/{0-install', 'rgw/thrash/{clusters/fixed-2', 'rgw/website/{clusters/fixed-2', 'rgw_frontend/beast', 'rgw_multipart_upload', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'rgw_ragweed', 'rgw_s3tests', 'rgw_user_quota}', 's3tests-branch', 's3tests}', 'supported-distros/{ubuntu_latest}', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rgw_s3tests}', 'tasks/s3/{auth-order/external-local', 'tasks/s3/{auth-order/local-external', 'tasks/s3tests-website}', 'tasks/{0-install', 'tasks/{rgw_bucket_quota', 'tasks/{s3tests}}', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'ubuntu_latest}', 'workload/rgw_s3tests}'] 2026-02-13T03:36:48.904 INFO:scrape: 2026-02-13T03:36:48.905 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f09e86aa48b] 2026-02-13T03:36:48.905 INFO:scrape:ceph version 20.2.0-661-g53394beb (53394beb8c756b8d9f25ca7d06447a8612d1e8c6) tentacle (stable - None) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f09e751d520] 2: pthread_kill() 3: raise() 4: abort() 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f09e86aa48b] 6: radosgw-admin(+0x5117dd) [0x564489d737dd] 7: radosgw-admin(+0x16b3e5f) [0x56448af15e5f] 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56448a4b72cd] 9: main() 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09e7504d90] 11: __libc_start_main() 12: _start() 2026-02-13T03:36:48.905 INFO:scrape:1 jobs: ['46218'] 2026-02-13T03:36:48.905 INFO:scrape:suites: ['accounts$/{tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}'] 2026-02-13T03:36:48.905 INFO:scrape: 2026-02-13T03:36:48.905 INFO:scrape:Failure: Command failed on trial007 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding|.*test_object_expiry.ObjectExpiryTest.test_get_object_after_expiry_time|.*test_object_expiry.ObjectExpiryTest.test_get_object_at_expiry_time|.*test_account_services.AccountTest.test_list_no_account_metadata'" 2026-02-13T03:36:48.905 INFO:scrape:1 jobs: ['46221'] 2026-02-13T03:36:48.905 INFO:scrape:suites: ['clusters/fixed-1', 'frontend/beast', 'ignore-pg-availability', 'overrides', 'rgw/tempest/{0-install', 's3tests-branch', 'tasks/tempest', 'ubuntu_latest}'] 2026-02-13T03:36:48.905 INFO:scrape: 2026-02-13T03:36:48.905 INFO:scrape:Failure: No module named 'boto.vendored.six.moves' 2026-02-13T03:36:48.905 INFO:scrape:3 jobs: ['46206', '46233', '46220'] 2026-02-13T03:36:48.905 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin'] 2026-02-13T03:36:48.905 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2026-02-13T03:36:48.905 INFO:scrape: 2026-02-13T03:36:48.905 INFO:scrape:Dead: None 2026-02-13T03:36:48.905 INFO:scrape:1 jobs: ['46223'] 2026-02-13T03:36:48.905 INFO:scrape: 2026-02-13T03:36:48.905 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f527aba148b] 2026-02-13T03:36:48.905 INFO:scrape:ceph version 20.2.0-661-g53394beb (53394beb8c756b8d9f25ca7d06447a8612d1e8c6) tentacle (stable - None) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5279a14520] 2: pthread_kill() 3: raise() 4: abort() 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f527aba148b] 6: radosgw-admin(+0x5117dd) [0x55b74658f7dd] 7: radosgw-admin(+0x16b3e5f) [0x55b747731e5f] 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b746cd32cd] 9: main() 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52799fbd90] 11: __libc_start_main() 12: _start() 2026-02-13T03:36:48.905 INFO:scrape:1 jobs: ['46212'] 2026-02-13T03:36:48.905 INFO:scrape:suites: ['accounts$/{main-tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/lockdep}', 'versioning', 'zzz-s3tests-java}'] 2026-02-13T03:36:48.905 INFO:scrape: 2026-02-13T03:36:48.905 INFO:scrape:Failure: Command failed (bucket notification tests against different endpoints) on trial096 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' 2026-02-13T03:36:48.905 INFO:scrape:3 jobs: ['46204', '46215', '46231'] 2026-02-13T03:36:48.905 INFO:scrape:suites intersection: ['bluestore-bitmap', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'valgrind}'] 2026-02-13T03:36:48.905 INFO:scrape:suites union: ['bluestore-bitmap', 'centos_latest', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'supported-distros/{centos_latest}', 'supported-distros/{ubuntu_latest}', 'tasks/amqp/{0-install', 'tasks/http/{0-install', 'tasks/kafka_failover/{0-install', 'test_amqp}', 'test_http}', 'test_kafka}', 'valgrind}'] 2026-02-13T03:36:48.905 INFO:scrape: 2026-02-13T03:36:48.906 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f759822648b] 2026-02-13T03:36:48.906 INFO:scrape:ceph version 20.2.0-661-g53394beb (53394beb8c756b8d9f25ca7d06447a8612d1e8c6) tentacle (stable - None) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7597099520] 2: pthread_kill() 3: raise() 4: abort() 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f759822648b] 6: radosgw-admin(+0x5117dd) [0x55a5967f57dd] 7: radosgw-admin(+0x16b3e5f) [0x55a597997e5f] 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a596f392cd] 9: main() 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7597080d90] 11: __libc_start_main() 12: _start() 2026-02-13T03:36:48.906 INFO:scrape:1 jobs: ['46229'] 2026-02-13T03:36:48.906 INFO:scrape:suites: ['accounts$/{none}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/lockdep}', 'versioning', 'zzz-s3tests-java}'] 2026-02-13T03:36:48.906 INFO:scrape: 2026-02-13T03:36:48.906 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f1266a3f48b] 2026-02-13T03:36:48.906 INFO:scrape:ceph version 20.2.0-661-g53394beb (53394beb8c756b8d9f25ca7d06447a8612d1e8c6) tentacle (stable - None) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f12658b2520] 2: pthread_kill() 3: raise() 4: abort() 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18d) [0x7f1266a3f48b] 6: radosgw-admin(+0x5117dd) [0x55e3fa78a7dd] 7: radosgw-admin(+0x16b3e5f) [0x55e3fb92ce5f] 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3faece2cd] 9: main() 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1265899d90] 11: __libc_start_main() 12: _start() 2026-02-13T03:36:48.906 INFO:scrape:1 jobs: ['46237'] 2026-02-13T03:36:48.906 INFO:scrape:suites: ['accounts$/{main-tenant}', 'bucket-check', 'cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'rados-pool-quota', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{admin-pagination', 'validater/valgrind}', 'versioning', 'zzz-s3tests-java}'] 2026-02-13T03:36:48.906 INFO:scrape: 2026-02-13T03:36:48.906 INFO:scrape:Failure: rgw multisite test failures 2026-02-13T03:36:48.906 INFO:scrape:1 jobs: ['46225'] 2026-02-13T03:36:48.906 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zones', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'tasks/test_multi}'] 2026-02-13T03:36:48.906 INFO:scrape: 2026-02-13T03:36:48.906 INFO:scrape:Failure: Failed to reconnect to trial195 2026-02-13T03:36:48.906 INFO:scrape:1 jobs: ['46203'] 2026-02-13T03:36:48.906 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] 2026-02-13T03:36:48.906 INFO:scrape: 2026-02-13T03:36:48.907 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial ================================================================= info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/ logs: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/ failed: 29 dead: 0 running: 0 waiting: 1 queued: 0 passed: 15 Fail ================================================================= [46195] rgw/bucket-logging/{0-install beast fixed-1 ignore-pg-availability overrides s3tests-branch supported-distros/{ubuntu_latest} tasks/{s3tests}} ----------------------------------------------------------------- time: 00:06:58 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46195/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46195/ Command failed (s3 tests against rgw) on trial020 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and bucket_logging'" [46197] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:16:00 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46197/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46197/ Command failed (s3 tests against rgw) on trial149 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46200] rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{centos_latest} tasks/rgw_s3tests} ----------------------------------------------------------------- time: 00:32:52 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46200/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46200/ Command failed (s3 tests against rgw) on trial114 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46202] rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota} ubuntu_latest} ----------------------------------------------------------------- time: 00:15:07 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46202/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46202/ Command failed (s3 tests against rgw) on trial031 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46203] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46203/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46203/ Failed to reconnect to trial195 [46204] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/amqp/{0-install centos_latest test_amqp} valgrind} ----------------------------------------------------------------- time: 00:06:07 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46204/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46204/ Command failed (bucket notification tests against different endpoints) on trial096 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/r gw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/sr c/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' [46206] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:27 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46206/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46206/ No module named 'boto.vendored.six.moves' [46207] rgw/sts/{auth-order/local-sts cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install 1-keycloak 2-s3tests}} ----------------------------------------------------------------- time: 00:29:53 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46207/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46207/ Command failed (s3 tests against rgw) on trial107 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46208] rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/s3/{auth-order/external-local s3tests} ubuntu_latest} ----------------------------------------------------------------- time: 00:18:43 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46208/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46208/ Command failed (s3 tests against rgw) on trial050 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46212] rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} ----------------------------------------------------------------- time: 00:38:17 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46212/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46212/ Command failed (s3 tests against rgw) on trial006 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46213] rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/s3tests-website} ----------------------------------------------------------------- time: 00:23:35 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46213/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46213/ Command failed (s3 tests against rgw) on trial163 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46214] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:14:15 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46214/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46214/ Command failed (s3 tests against rgw) on trial091 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46215] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/http/{0-install supported-distros/{ubuntu_latest} test_http} valgrind} ----------------------------------------------------------------- time: 00:09:32 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46215/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46215/ Command failed (bucket notification tests against different endpoints) on trial014 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/r gw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/sr c/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a http_test' [46218] rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} ----------------------------------------------------------------- time: 01:05:04 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46218/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46218/ Command failed (s3 tests against rgw) on trial172 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46219] rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota} ubuntu_latest} ----------------------------------------------------------------- time: 00:17:19 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46219/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46219/ Command failed (s3 tests against rgw) on trial106 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46220] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:01 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46220/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46220/ No module named 'boto.vendored.six.moves' [46221] rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:08:22 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46221/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46221/ Command failed on trial007 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative .AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_nega tive.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerN egativeTest.test_create_container_metadata_.*|.*test_container_staticweb.St aticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_we b_listing_css|.*test_container_synchronization.*|.*test_object_services.Pub licObjectTest.test_access_public_container_object_without_using_creds|.*tes t_object_services.ObjectTest.test_create_object_with_transfer_encoding|.*te st_object_expiry.ObjectExpiryTest.test_get_object_after_expiry_time|.*test_ object_expiry.ObjectExpiryTest.test_get_object_at_expiry_time|.*test_accoun t_services.AccountTest.test_list_no_account_metadata'" [46222] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:13:54 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46222/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46222/ Command failed (s3 tests against rgw) on trial058 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46225] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi} ----------------------------------------------------------------- time: 00:38:00 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46225/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46225/ rgw multisite test failures [46226] rgw/sts/{auth-order/sts-local cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install 1-keycloak 2-s3tests}} ----------------------------------------------------------------- time: 00:29:33 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46226/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46226/ Command failed (s3 tests against rgw) on trial033 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46227] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:15:14 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46227/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46227/ Command failed (s3 tests against rgw) on trial159 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46229] rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} ----------------------------------------------------------------- time: 00:38:54 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46229/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46229/ Command failed (s3 tests against rgw) on trial034 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46230] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:13:23 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46230/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46230/ Command failed (s3 tests against rgw) on trial153 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46231] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/kafka_failover/{0-install supported-distros/{centos_latest} test_kafka} valgrind} ----------------------------------------------------------------- time: 00:15:29 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46231/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46231/ Command failed (bucket notification tests against different endpoints) on trial112 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/r gw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/sr c/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a kafka_failover' [46232] rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota} ubuntu_latest} ----------------------------------------------------------------- time: 00:17:52 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46232/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46232/ Command failed (s3 tests against rgw) on trial046 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46233] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:08:56 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46233/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46233/ No module named 'boto.vendored.six.moves' [46234] rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/s3/{auth-order/local-external s3tests} ubuntu_latest} ----------------------------------------------------------------- time: 00:18:51 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46234/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46234/ Command failed (s3 tests against rgw) on trial156 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46237] rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} ----------------------------------------------------------------- time: 01:04:35 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46237/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46237/ Command failed (s3 tests against rgw) on trial049 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and not bucket_logging'" [46238] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:14:12 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46238/ log: https://qa-proxy.ceph.com/teuthology/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46238/ Command failed (s3 tests against rgw) on trial013 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not bucket_logging'" Waiting ================================================================= [46223] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/kafka/{0-install supported-distros/{ubuntu_latest} test_kafka} valgrind} info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46223/ Pass ================================================================= [46196] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/restore/cloud_restore_s3tests} time: 00:27:20 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46196/ [46198] rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests} time: 00:06:36 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46198/ [46199] rgw/dedup/{beast bluestore-bitmap fixed-3-rgw ignore-pg-availability overrides supported-distros/{centos_latest} tasks/{0-install test_dedup}} time: 00:18:24 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46199/ [46201] rgw/lua/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides supported-distros/{ubuntu_latest} tasks/{0-install test_lua}} time: 00:06:56 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46201/ [46205] rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/service-token ubuntu_latest} time: 00:06:43 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46205/ [46209] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:07:03 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46209/ [46210] rgw/tools/{centos_latest cluster ignore-pg-availability tasks} time: 00:09:47 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46210/ [46211] rgw/upgrade/{1-install/reef/{distro$/{ubuntu_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:08:30 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46211/ [46216] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:07:47 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46216/ [46217] rgw/upgrade/{1-install/squid/{distro$/{ubuntu_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:09:30 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46217/ [46224] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/transition/cloud_transition_s3tests} time: 00:31:11 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46224/ [46228] rgw/upgrade/{1-install/squid/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:09:34 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46228/ [46235] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:08:49 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46235/ [46236] rgw/upgrade/{1-install/reef/{distro$/{ubuntu_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:07:02 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46236/ [46239] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{ubuntu_latest} test_others} valgrind} time: 00:10:09 info: https://pulpito.ceph.com/yuriw-2026-02-12_15:34:00-rgw-wip-yuri2-testing-2026-02-11-2258-tentacle-distro-default-trial/46239/ 2026-02-13T03:36:48.913 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 33, in main results(args['--archive-dir'], args['--name'], args['--email'], File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 78, in results email_results( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 95, in email_results smtp = smtplib.SMTP('localhost') ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 255, in __init__ (code, msg) = self.connect(host, port) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 341, in connect self.sock = self._get_socket(host, port, self.timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket return socket.create_connection((host, port), timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused