2022-08-29T12:39:12.645 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-08-29T12:39:12.646 INFO:teuthology.results:subset: '1/2' 2022-08-29T12:39:12.647 INFO:teuthology.results:seed: '7602' 2022-08-29T12:56:36.308 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-08-29T12:56:36.314 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-08-29T16:33:53.172 INFO:teuthology.results:Tests finished! gathering results... 2022-08-29T16:33:59.692 INFO:scrape:Found 71 jobs 2022-08-29T16:34:07.010 INFO:scrape:Found 7 distinct failure reasons 2022-08-29T16:34:07.011 INFO:scrape:Failure: Command failed on smithi191 with status 1: 'sudo yum -y install ceph-test' 2022-08-29T16:34:07.011 INFO:scrape:14 jobs: ['6997948', '6997990', '6997976', '6997944', '6997968', '6997940', '6997978', '6997958', '6997943', '6997945', '6997988', '6997966', '6997979', '6997957'] 2022-08-29T16:34:07.012 INFO:scrape:suites intersection: [] 2022-08-29T16:34:07.012 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/kmip', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_old', '3-rgw/rgw', '4-tests/{s3tests}', 'bluestore-bitmap', 'cluster', 'first', 'fixed-2', 'frontend/beast', 'ignore-pg-availability', 'notify', 'objectstore', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'omap_limits', 'overrides', 'pool-type', 'realms/two-zonegroup', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/lifecycle/{cluster', 'rgw/multisite/{clusters', 'rgw/notifications/{beast', 'rgw/singleton/{all/radosgw-admin', 'rgw/sts/{cluster', 'rgw/tools/{centos_latest', 'rgw_frontend/beast', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 'ststests}}', 'supported-all-distro$/{centos_8}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/rgw_s3tests}', 'tasks/test_multi}', 'tasks/{0-install', 'tasks}', 'test_amqp', 'test_kafka', 'test_others}}'] 2022-08-29T16:34:07.013 INFO:scrape: 2022-08-29T16:34:07.013 INFO:scrape:Failure: Command failed on smithi063 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd' 2022-08-29T16:34:07.014 INFO:scrape:24 jobs: ['6997951', '6998004', '6997955', '6997949', '6997996', '6998006', '6997971', '6997995', '6997973', '6998000', '6997969', '6997992', '6997974', '6997959', '6997953', '6997983', '6997987', '6997965', '6997961', '6997963', '6998003', '6997984', '6997981', '6997991'] 2022-08-29T16:34:07.015 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'tasks/{cls'] 2022-08-29T16:34:07.015 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] 2022-08-29T16:34:07.016 INFO:scrape: 2022-08-29T16:34:07.017 INFO:scrape:Failure: rgw multisite test failures 2022-08-29T16:34:07.017 INFO:scrape:1 jobs: ['6997942'] 2022-08-29T16:34:07.018 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] 2022-08-29T16:34:07.019 INFO:scrape: 2022-08-29T16:34:07.019 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0b3cdec44618cc429ba47e22123fb1a19930c599 2022-08-29T16:34:07.020 INFO:scrape:2 jobs: ['6997977', '6997939'] 2022-08-29T16:34:07.021 INFO:scrape:suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2022-08-29T16:34:07.022 INFO:scrape:suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2022-08-29T16:34:07.023 INFO:scrape: 2022-08-29T16:34:07.024 INFO:scrape:Failure: Cannot create secret 2022-08-29T16:34:07.024 INFO:scrape:1 jobs: ['6997937'] 2022-08-29T16:34:07.025 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'supported-random-distro$/{ubuntu_latest}}'] 2022-08-29T16:34:07.026 INFO:scrape: 2022-08-29T16:34:07.026 INFO:scrape:Failure: {'smithi039.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': True, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '}, {'_ansible_item_label': 'http://download.ceph.com/keys/release.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': False, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/release.asc'}]}} 2022-08-29T16:34:07.027 INFO:scrape:1 jobs: ['6997989'] 2022-08-29T16:34:07.028 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 's3tests-branch', 'tasks/rgw_bucket_quota', 'ubuntu_latest}'] 2022-08-29T16:34:07.029 INFO:scrape: 2022-08-29T16:34:07.029 INFO:scrape:Failure: Command failed on smithi032 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'" 2022-08-29T16:34:07.030 INFO:scrape:1 jobs: ['6997946'] 2022-08-29T16:34:07.031 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2022-08-29T16:34:07.031 INFO:scrape: