2023-10-21T09:40:15.784 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T09:40:15.785 INFO:teuthology.results:subset: '111/12000' 2023-10-21T09:40:15.786 INFO:teuthology.results:seed: '6595' 2023-10-21T10:16:11.623 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T10:16:11.626 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-21T13:09:25.508 INFO:teuthology.results:Tests finished! gathering results... 2023-10-21T13:09:28.461 INFO:scrape:Found 42 jobs 2023-10-21T13:09:31.373 INFO:scrape:Found 4 distinct failure reasons 2023-10-21T13:09:31.374 INFO:scrape:Failure: ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] 2023-10-21T13:09:31.374 INFO:scrape:21 jobs: ['7433823', '7433880', '7433867', '7433833', '7433853', '7433876', '7433839', '7433859', '7433875', '7433851', '7433887', '7433829', '7433873', '7433825', '7433888', '7433892', '7433890', '7433819', '7433894', '7433882', '7433847'] 2023-10-21T13:09:31.375 INFO:scrape:suites intersection: ['ignore-pg-availability'] 2023-10-21T13:09:31.375 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_old', '2-setup', '3-rgw/rgw', '3-upgrade-sequence/osds-then-rgws', '3-upgrade-sequence/rgws-then-osds', '4-tests/{s3tests}', 'cls', 'cluster', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'http', 'ignore-pg-availability', 'inline-data$/{off}', 'install', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'overrides}', 'proto/https', 'ragweed', 'reshard', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/dbstore/{cluster', 'rgw/lifecycle/{cluster', 'rgw/multifs/{clusters/fixed-2', 'rgw/service-token/{clusters/fixed-1', 'rgw/singleton/{all/radosgw-admin', 'rgw/thrash/{clusters/fixed-2', 'rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04}', 'rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04}', 'rgw/verify/{0-install', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rgw_bucket_quota', 'tasks/rgw_multipart_upload', 'tasks/rgw_ragweed', 'tasks/rgw_s3tests', 'tasks/rgw_s3tests}', 'tasks/rgw_user_quota', 'tasks/s3tests-website', 'tasks/service-token', 'tasks/{bucket-check', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'ubuntu_latest}', 'validater/lockdep}', 'versioning}', 'workload/rgw_bucket_quota}', 'workload/rgw_multipart_upload}'] 2023-10-21T13:09:31.375 INFO:scrape: 2023-10-21T13:09:31.376 INFO:scrape:Failure: HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) 2023-10-21T13:09:31.376 INFO:scrape:10 jobs: ['7433849', '7433843', '7433896', '7433871', '7433817', '7433827', '7433837', '7433841', '7433831', '7433815'] 2023-10-21T13:09:31.377 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap'] 2023-10-21T13:09:31.377 INFO:scrape:suites union: ['2-setup', '3-upgrade-sequence/osds-then-rgws', 'cluster', 'frontend/beast', 'ignore-pg-availability', 'install', 'objectstore/bluestore-bitmap', 'overrides', 'overrides}', 'rgw/singleton/{all/radosgw-admin', 'rgw/thrash/{clusters/fixed-2', 'rgw/upgrade/{1-install/pacific/{distro$/{centos_8.stream}', 'rgw_pool_type/replicated', 's3tests-branch', 'supported-random-distro$/{centos_latest}}', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'workload/rgw_user_quota}'] 2023-10-21T13:09:31.377 INFO:scrape: 2023-10-21T13:09:31.378 INFO:scrape:Failure: Command failed on smithi026 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1jammy cephadm=18.0.0-6820-gf0804064-1jammy ceph-mds=18.0.0-6820-gf0804064-1jammy ceph-mgr=18.0.0-6820-gf0804064-1jammy ceph-common=18.0.0-6820-gf0804064-1jammy ceph-fuse=18.0.0-6820-gf0804064-1jammy ceph-test=18.0.0-6820-gf0804064-1jammy ceph-volume=18.0.0-6820-gf0804064-1jammy radosgw=18.0.0-6820-gf0804064-1jammy python3-rados=18.0.0-6820-gf0804064-1jammy python3-rgw=18.0.0-6820-gf0804064-1jammy python3-cephfs=18.0.0-6820-gf0804064-1jammy python3-rbd=18.0.0-6820-gf0804064-1jammy libcephfs2=18.0.0-6820-gf0804064-1jammy libcephfs-dev=18.0.0-6820-gf0804064-1jammy librados2=18.0.0-6820-gf0804064-1jammy librbd1=18.0.0-6820-gf0804064-1jammy rbd-fuse=18.0.0-6820-gf0804064-1jammy' 2023-10-21T13:09:31.378 INFO:scrape:4 jobs: ['7433865', '7433855', '7433878', '7433845'] 2023-10-21T13:09:31.379 INFO:scrape:suites intersection: ['ignore-pg-availability'] 2023-10-21T13:09:31.379 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/d4n/{cluster', 'rgw/multisite/{clusters', 'rgw/tempest/{clusters/fixed-1', 's3tests-branch', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rgw_d4ntests}', 'tasks/rgw_tempest', 'tasks/test_multi}', 'ubuntu_latest}'] 2023-10-21T13:09:31.379 INFO:scrape: 2023-10-21T13:09:31.380 INFO:scrape:Failure: Command failed on smithi130 with status 1: 'sudo chkconfig rabbitmq-server on' 2023-10-21T13:09:31.380 INFO:scrape:1 jobs: ['7433857'] 2023-10-21T13:09:31.381 INFO:scrape:suites: ['bluestore-bitmap', 'centos_latest', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'tasks/{0-install', 'test_amqp', 'test_kafka', 'test_others}}'] 2023-10-21T13:09:31.381 INFO:scrape: 2023-10-21T13:09:31.383 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/ failed: 15 dead: 21 running: 0 waiting: 0 queued: 0 passed: 6 Fail ================================================================= [7433815] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433815/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433815/ sentry: https://sentry.ceph.com/organizations/ceph/?query=311c58a154c042f7ba7d9efe7812e733 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F22.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433817] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433817/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433817/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b01ae4a26a1421ebd0bbe6389a84229 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F22.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433827] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433827/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433827/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d7ed5b580fd4e439085587364806e9f HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cf c/centos/9/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433831] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} ----------------------------------------------------------------- time: 00:11:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433831/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433831/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e315a1201414daf9e9582361598cf46 HTTPSConnectionPool(host='3.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cf c/ubuntu/jammy/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433837] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433837/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433837/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6afdcca1e6d749acb0591289e97c03c1 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F22.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433841] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{centos_latest} tasks/cloud_transition_s3tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433841/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433841/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed59c1b5ebd24047bd9ca95c3f5b15cd HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F9%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433843] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433843/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433843/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8dd3decfc5214e5dacd90cf7c599b9e5 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F22.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433845] rgw/d4n/{cluster ignore-pg-availability overrides supported-random-distro$/{ubuntu_latest} tasks/rgw_d4ntests} ----------------------------------------------------------------- time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433845/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433845/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9eba03c44c734051b9e523f008e4d8fc Command failed on smithi195 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1jammy cephadm=18.0.0-6820-gf0804064-1jammy ceph-mds=18.0.0-6820-gf0804064-1jammy ceph-mgr=18.0.0-6820-gf0804064-1jammy ceph-common=18.0.0-6820-gf0804064-1jammy ceph- fuse=18.0.0-6820-gf0804064-1jammy ceph-test=18.0.0-6820-gf0804064-1jammy ceph-volume=18.0.0-6820-gf0804064-1jammy radosgw=18.0.0-6820-gf0804064-1jammy python3-rados=18.0.0-6820-gf0804064-1jammy python3-rgw=18.0.0-6820-gf0804064-1jammy python3-cephfs=18.0.0-6820-gf0804064-1jammy python3-rbd=18.0.0-6820-gf0804064-1jammy libcephfs2=18.0.0-6820-gf0804064-1jammy libcephfs- dev=18.0.0-6820-gf0804064-1jammy librados2=18.0.0-6820-gf0804064-1jammy librbd1=18.0.0-6820-gf0804064-1jammy rbd-fuse=18.0.0-6820-gf0804064-1jammy' [7433849] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default ignore-pg-availability overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433849/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433849/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ce46dd4d1b84242934067b768cec7ec HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433855] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} ----------------------------------------------------------------- time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433855/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433855/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83b9a7e21df549a9a720e8478ce5d0db Command failed on smithi059 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1jammy cephadm=18.0.0-6820-gf0804064-1jammy ceph-mds=18.0.0-6820-gf0804064-1jammy ceph-mgr=18.0.0-6820-gf0804064-1jammy ceph-common=18.0.0-6820-gf0804064-1jammy ceph- fuse=18.0.0-6820-gf0804064-1jammy ceph-test=18.0.0-6820-gf0804064-1jammy ceph-volume=18.0.0-6820-gf0804064-1jammy radosgw=18.0.0-6820-gf0804064-1jammy python3-rados=18.0.0-6820-gf0804064-1jammy python3-rgw=18.0.0-6820-gf0804064-1jammy python3-cephfs=18.0.0-6820-gf0804064-1jammy python3-rbd=18.0.0-6820-gf0804064-1jammy libcephfs2=18.0.0-6820-gf0804064-1jammy libcephfs- dev=18.0.0-6820-gf0804064-1jammy librados2=18.0.0-6820-gf0804064-1jammy librbd1=18.0.0-6820-gf0804064-1jammy rbd-fuse=18.0.0-6820-gf0804064-1jammy' [7433857] rgw/notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} ----------------------------------------------------------------- time: 00:30:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433857/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433857/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b023bfaf81146f4afa97b852ed0503e Command failed on smithi130 with status 1: 'sudo chkconfig rabbitmq-server on' [7433865] rgw/tempest/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433865/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433865/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd3382e90209493fbce1c78a98e02df0 Command failed on smithi026 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1jammy cephadm=18.0.0-6820-gf0804064-1jammy ceph-mds=18.0.0-6820-gf0804064-1jammy ceph-mgr=18.0.0-6820-gf0804064-1jammy ceph-common=18.0.0-6820-gf0804064-1jammy ceph- fuse=18.0.0-6820-gf0804064-1jammy ceph-test=18.0.0-6820-gf0804064-1jammy ceph-volume=18.0.0-6820-gf0804064-1jammy radosgw=18.0.0-6820-gf0804064-1jammy python3-rados=18.0.0-6820-gf0804064-1jammy python3-rgw=18.0.0-6820-gf0804064-1jammy python3-cephfs=18.0.0-6820-gf0804064-1jammy python3-rbd=18.0.0-6820-gf0804064-1jammy libcephfs2=18.0.0-6820-gf0804064-1jammy libcephfs- dev=18.0.0-6820-gf0804064-1jammy librados2=18.0.0-6820-gf0804064-1jammy librbd1=18.0.0-6820-gf0804064-1jammy rbd-fuse=18.0.0-6820-gf0804064-1jammy' [7433871] rgw/upgrade/{1-install/pacific/{distro$/{centos_8.stream} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} ----------------------------------------------------------------- time: 00:48:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433871/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433871/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb8208ffa41f4310afb34284aaf58e6c HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7433878] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:10:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433878/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433878/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7246c382e2549e79b10c3f67123464e Command failed on smithi163 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1jammy cephadm=18.0.0-6820-gf0804064-1jammy ceph-mds=18.0.0-6820-gf0804064-1jammy ceph-mgr=18.0.0-6820-gf0804064-1jammy ceph-common=18.0.0-6820-gf0804064-1jammy ceph- fuse=18.0.0-6820-gf0804064-1jammy ceph-test=18.0.0-6820-gf0804064-1jammy ceph-volume=18.0.0-6820-gf0804064-1jammy radosgw=18.0.0-6820-gf0804064-1jammy python3-rados=18.0.0-6820-gf0804064-1jammy python3-rgw=18.0.0-6820-gf0804064-1jammy python3-cephfs=18.0.0-6820-gf0804064-1jammy python3-rbd=18.0.0-6820-gf0804064-1jammy libcephfs2=18.0.0-6820-gf0804064-1jammy libcephfs- dev=18.0.0-6820-gf0804064-1jammy librados2=18.0.0-6820-gf0804064-1jammy librbd1=18.0.0-6820-gf0804064-1jammy rbd-fuse=18.0.0-6820-gf0804064-1jammy' [7433896] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 ignore-pg-availability overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433896/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433896/ sentry: https://sentry.ceph.com/organizations/ceph/?query=277fd744547a4e90a44fad736c685f00 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) Dead ================================================================= [7433819] rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} ----------------------------------------------------------------- time: 00:03:18 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433819/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433819/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b45776ba544845ffb8555fc5a48e0bca ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433823] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_ragweed ubuntu_latest} ----------------------------------------------------------------- time: 00:03:42 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433823/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433823/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d9b42a08e67341b09f6597105420fc66 ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433825] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433825/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433825/ sentry: https://sentry.ceph.com/organizations/ceph/?query=712373584b5b4fd8911f788e4cfb4fd0 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433829] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_s3tests ubuntu_latest} ----------------------------------------------------------------- time: 00:03:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433829/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433829/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83dc0757d61241449134a4d3734e39ed ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433833] rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} ----------------------------------------------------------------- time: 00:03:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433833/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433833/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fab4491d2a844c6aa020485ff3001686 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433839] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_user_quota ubuntu_latest} ----------------------------------------------------------------- time: 00:03:39 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433839/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433839/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f7d76ba113f2439e94585de9148b4d0b ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433847] rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433847/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433847/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c635ca8a81e4920b3d9213628dcc4b4 ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433851] rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests} ----------------------------------------------------------------- time: 00:03:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433851/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433851/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae1871638627488c9dfc2ff91369feac ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433853] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_bucket_quota ubuntu_latest} ----------------------------------------------------------------- time: 00:03:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433853/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433853/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5c5ad9dbe344579ad75735de4da3a9a ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433859] rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/service-token ubuntu_latest} ----------------------------------------------------------------- time: 00:03:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433859/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433859/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88c5143482b64b1a912037a3c190c024 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433867] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:07:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433867/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433867/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cbb3fa16cb7c489798d3213a5d09537f ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433873] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} ----------------------------------------------------------------- time: 00:03:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433873/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433873/ sentry: https://sentry.ceph.com/organizations/ceph/?query=206b4b599df9472092633d2e730a93c2 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433875] rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch tasks/s3tests-website ubuntu_latest} ----------------------------------------------------------------- time: 00:03:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433875/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433875/ sentry: https://sentry.ceph.com/organizations/ceph/?query=34358d75968140f0bb4c16fe4561af79 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433876] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_multipart_upload ubuntu_latest} ----------------------------------------------------------------- time: 00:03:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433876/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433876/ sentry: https://sentry.ceph.com/organizations/ceph/?query=260e24f6aee94e4899330b22c870e714 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433880] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433880/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74a0cacbc4fe4c489ba7ccdc16ccbcae ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433882] rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} ----------------------------------------------------------------- time: 00:06:02 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433882/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433882/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c503f88829d453496770ea0eb0dd5a3 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433887] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_ragweed ubuntu_latest} ----------------------------------------------------------------- time: 00:03:47 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433887/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433887/ sentry: https://sentry.ceph.com/organizations/ceph/?query=127c9cfe76fe4fb285e2c7952d9a65b7 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433888] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:03:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433888/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433888/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad1e361e36d94712a2d3a092b8f1206f ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433890] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:07:46 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433890/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433890/ sentry: https://sentry.ceph.com/organizations/ceph/?query=426a471ddd074d908b4ea8a2d037f416 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7433892] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_s3tests ubuntu_latest} ----------------------------------------------------------------- time: 00:03:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433892/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433892/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5deab9a1f1eb4d28ad8d1e0c381339b6 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7433894] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:03:33 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433894/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433894/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f6d4064bcd34421ab5360f5bcb81e7e ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] Pass ================================================================= [7433821] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:48:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433821/ [7433835] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 00:59:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433835/ [7433861] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} time: 00:40:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433861/ [7433863] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install 1-keycloak 2-s3tests}} time: 00:40:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433863/ [7433869] rgw/tools/{centos_latest cluster ignore-pg-availability tasks} time: 02:58:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433869/ [7433885] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 00:57:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:43:51-rgw-main-distro-default-smithi/7433885/