2026-02-12T21:21:49.407 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T21:21:49.407 INFO:teuthology.results:subset: '1/130000' 2026-02-12T21:21:49.408 INFO:teuthology.results:seed: '2234' 2026-02-12T21:42:05.487 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T21:42:05.494 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2026-02-13T09:42:51.601 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2026-02-13T09:42:52.715 INFO:scrape:Found 45 jobs 2026-02-13T09:42:56.933 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46960/teuthology.log 2026-02-13T09:42:57.367 INFO:scrape:Found 7 distinct failure reasons 2026-02-13T09:42:57.368 INFO:scrape:Failure: Command failed (workunit test rgw/s3_user_quota-run.sh) on trial104 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6bfd96305a8aafd4753382504cd6cd99f33848a7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota-run.sh' 2026-02-13T09:42:57.368 INFO:scrape:3 jobs: ['46995', '46966', '46982'] 2026-02-13T09:42:57.368 INFO:scrape:suites intersection: ['clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{0-install', 'rgw_multipart_upload', 'rgw_ragweed', 'rgw_s3tests', 'rgw_user_quota}', 's3tests-branch', 'tasks/{rgw_bucket_quota', 'ubuntu_latest}'] 2026-02-13T09:42:57.368 INFO:scrape:suites union: ['clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{0-install', 'rgw_multipart_upload', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'rgw_ragweed', 'rgw_s3tests', 'rgw_user_quota}', 's3tests-branch', 'tasks/{rgw_bucket_quota', 'ubuntu_latest}'] 2026-02-13T09:42:57.368 INFO:scrape: 2026-02-13T09:42:57.368 INFO:scrape:Failure: No module named 'boto.vendored.six.moves' 2026-02-13T09:42:57.368 INFO:scrape:3 jobs: ['46983', '46996', '46970'] 2026-02-13T09:42:57.368 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin'] 2026-02-13T09:42:57.368 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2026-02-13T09:42:57.368 INFO:scrape: 2026-02-13T09:42:57.368 INFO:scrape:Failure: Command failed (bucket notification tests against different endpoints) on trial085 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' 2026-02-13T09:42:57.368 INFO:scrape:3 jobs: ['46968', '46978', '46994'] 2026-02-13T09:42:57.368 INFO:scrape:suites intersection: ['bluestore-bitmap', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'valgrind}'] 2026-02-13T09:42:57.368 INFO:scrape:suites union: ['bluestore-bitmap', 'centos_latest', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'supported-distros/{centos_latest}', 'supported-distros/{ubuntu_latest}', 'tasks/amqp/{0-install', 'tasks/http/{0-install', 'tasks/kafka_failover/{0-install', 'test_amqp}', 'test_http}', 'test_kafka}', 'valgrind}'] 2026-02-13T09:42:57.368 INFO:scrape: 2026-02-13T09:42:57.368 INFO:scrape:Failure: Failed to reconnect to trial070 2026-02-13T09:42:57.368 INFO:scrape:1 jobs: ['47001'] 2026-02-13T09:42:57.368 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}'] 2026-02-13T09:42:57.368 INFO:scrape: 2026-02-13T09:42:57.368 INFO:scrape:Failure: rgw multisite test failures 2026-02-13T09:42:57.368 INFO:scrape:2 jobs: ['46989', '46967'] 2026-02-13T09:42:57.368 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi}'] 2026-02-13T09:42:57.368 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'realms/two-zones', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] 2026-02-13T09:42:57.368 INFO:scrape: 2026-02-13T09:42:57.369 INFO:scrape:Dead: None 2026-02-13T09:42:57.369 INFO:scrape:1 jobs: ['46960'] 2026-02-13T09:42:57.369 INFO:scrape: 2026-02-13T09:42:57.369 INFO:scrape:Failure: Command failed (s3 tests against rgw) on trial157 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and bucket_logging'" 2026-02-13T09:42:57.369 INFO:scrape:1 jobs: ['46959'] 2026-02-13T09:42:57.369 INFO:scrape:suites: ['beast', 'fixed-1', 'ignore-pg-availability', 'overrides', 'rgw/bucket-logging/{0-install', 's3tests-branch', 'supported-distros/{ubuntu_latest}', 'tasks/{s3tests}}'] 2026-02-13T09:42:57.369 INFO:scrape: 2026-02-13T09:42:57.369 INFO:teuthology.results:Sending results to aemerson@redhat.com: Test Run: aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial ================================================================= info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/ logs: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/ failed: 13 dead: 0 running: 0 waiting: 1 queued: 0 passed: 31 Fail ================================================================= [46959] rgw/bucket-logging/{0-install beast fixed-1 ignore-pg-availability overrides s3tests-branch supported-distros/{ubuntu_latest} tasks/{s3tests}} ----------------------------------------------------------------- time: 00:07:16 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46959/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46959/ Command failed (s3 tests against rgw) on trial157 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and bucket_logging'" [46966] rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota} ubuntu_latest} ----------------------------------------------------------------- time: 00:16:27 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46966/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46966/ Command failed (workunit test rgw/s3_user_quota-run.sh) on trial038 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6bfd96305a8aafd4753382504cd6cd99f33848a7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota-run.sh' [46967] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} ----------------------------------------------------------------- time: 00:46:04 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46967/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46967/ rgw multisite test failures [46968] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/amqp/{0-install centos_latest test_amqp} valgrind} ----------------------------------------------------------------- time: 00:06:59 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46968/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46968/ Command failed (bucket notification tests against different endpoints) on trial085 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/r gw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/sr c/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' [46970] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:06 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46970/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46970/ No module named 'boto.vendored.six.moves' [46978] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/http/{0-install supported-distros/{centos_latest} test_http} valgrind} ----------------------------------------------------------------- time: 00:06:43 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46978/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46978/ Command failed (bucket notification tests against different endpoints) on trial145 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/r gw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/sr c/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a http_test' [46982] rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota} ubuntu_latest} ----------------------------------------------------------------- time: 00:16:24 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46982/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46982/ Command failed (workunit test rgw/s3_user_quota-run.sh) on trial110 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6bfd96305a8aafd4753382504cd6cd99f33848a7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota-run.sh' [46983] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:09 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46983/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46983/ No module named 'boto.vendored.six.moves' [46989] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} ----------------------------------------------------------------- time: 00:40:04 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46989/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46989/ rgw multisite test failures [46994] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/kafka_failover/{0-install supported-distros/{ubuntu_latest} test_kafka} valgrind} ----------------------------------------------------------------- time: 00:14:16 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46994/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46994/ Command failed (bucket notification tests against different endpoints) on trial049 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/r gw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/sr c/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a kafka_failover' [46995] rgw/multifs/{0-install clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/{rgw_bucket_quota rgw_multipart_upload rgw_ragweed rgw_s3tests rgw_user_quota} ubuntu_latest} ----------------------------------------------------------------- time: 00:16:14 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46995/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46995/ Command failed (workunit test rgw/s3_user_quota-run.sh) on trial104 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6bfd96305a8aafd4753382504cd6cd99f33848a7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota-run.sh' [46996] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:06:56 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46996/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46996/ No module named 'boto.vendored.six.moves' [47001] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/47001/ log: https://qa-proxy.ceph.com/teuthology/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/47001/ Failed to reconnect to trial070 Waiting ================================================================= [46960] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{centos_latest} tasks/restore/cloud_restore_s3tests} info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46960/ Pass ================================================================= [46958] rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} time: 00:38:08 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46958/ [46961] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} time: 00:16:18 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46961/ [46962] rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests} time: 00:06:35 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46962/ [46963] rgw/dedup/{beast bluestore-bitmap fixed-3-rgw ignore-pg-availability overrides supported-distros/{ubuntu_latest} tasks/{0-install test_dedup}} time: 00:19:54 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46963/ [46964] rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests} time: 00:32:47 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46964/ [46965] rgw/lua/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides supported-distros/{ubuntu_latest} tasks/{0-install test_lua}} time: 00:05:49 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46965/ [46969] rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/service-token ubuntu_latest} time: 00:05:26 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46969/ [46971] rgw/sts/{auth-order/local-sts cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install 1-keycloak 2-s3tests}} time: 00:30:18 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46971/ [46972] rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/s3/{auth-order/external-local s3tests} ubuntu_latest} time: 00:18:06 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46972/ [46973] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:05:50 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46973/ [46974] rgw/tools/{centos_latest cluster ignore-pg-availability tasks} time: 00:09:26 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46974/ [46975] rgw/upgrade/{1-install/reef/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:08:00 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46975/ [46976] rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch tasks/s3tests-website ubuntu_latest} time: 00:13:03 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46976/ [46977] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} time: 00:13:28 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46977/ [46979] rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} time: 01:09:54 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46979/ [46980] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:05:22 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46980/ [46981] rgw/upgrade/{1-install/squid/{distro$/{ubuntu_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:07:58 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46981/ [46984] rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/tempest ubuntu_latest} time: 00:07:58 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46984/ [46985] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} time: 00:13:10 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46985/ [46986] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/kafka/{0-install supported-distros/{ubuntu_latest} test_kafka} valgrind} time: 00:11:36 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46986/ [46987] rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/lockdep} time: 00:42:54 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46987/ [46988] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{centos_latest} tasks/transition/cloud_transition_s3tests} time: 00:29:31 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46988/ [46990] rgw/sts/{auth-order/sts-local cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install 1-keycloak 2-s3tests}} time: 00:30:07 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46990/ [46991] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} time: 00:12:58 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46991/ [46992] rgw/upgrade/{1-install/squid/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:10:04 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46992/ [46993] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} time: 00:13:17 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46993/ [46997] rgw/tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/s3/{auth-order/local-external s3tests} ubuntu_latest} time: 00:15:33 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46997/ [46998] rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} time: 00:52:31 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46998/ [46999] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:05:48 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/46999/ [47000] rgw/upgrade/{1-install/reef/{distro$/{ubuntu_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:06:29 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/47000/ [47002] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{ubuntu_latest} test_others} valgrind} time: 00:08:02 info: https://pulpito.ceph.com/aemerson-2026-02-12_17:33:51-rgw-wip-74526-tentacle-distro-default-trial/47002/ 2026-02-13T09:42:57.377 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 33, in main results(args['--archive-dir'], args['--name'], args['--email'], File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 78, in results email_results( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 95, in email_results smtp = smtplib.SMTP('localhost') ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 255, in __init__ (code, msg) = self.connect(host, port) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 341, in connect self.sock = self._get_socket(host, port, self.timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket return socket.create_connection((host, port), timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused