2022-07-19T07:34:44.821 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5
2022-07-19T07:34:44.867 INFO:teuthology.results:subset: '1/3'
2022-07-19T07:34:44.868 INFO:teuthology.results:seed: '8757'
2022-07-19T08:04:40.944 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5
2022-07-19T08:04:41.385 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-07-19T12:57:09.453 INFO:teuthology.results:Tests finished! gathering results...
2022-07-19T12:57:16.136 INFO:scrape:Found 58 jobs
2022-07-19T12:57:35.427 INFO:scrape:Found 8 distinct failure reasons
2022-07-19T12:57:35.428 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi167 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests-client.0/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests-client.0 -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"
2022-07-19T12:57:35.429 INFO:scrape:7 jobs: ['6938023', '6937996', '6938019', '6938021', '6938004', '6937994', '6937985']
2022-07-19T12:57:35.430 INFO:scrape:suites intersection: ['s3tests-branch']
2022-07-19T12:57:35.430 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/vault_kv', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}', 'frontend/beast', 'http', 'ignore-pg-availability', 'install', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multifs/{clusters/fixed-2', 'rgw/thrash/{clusters/fixed-2', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 's3tests-branch', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rgw_s3tests', 'tasks/s3tests-website', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'ubuntu_latest}', 'workload/rgw_s3tests}']
2022-07-19T12:57:35.431 INFO:scrape:
2022-07-19T12:57:35.431 INFO:scrape:Crash: Command failed (s3 tests against rgw) on smithi017 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests-client.0/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests-client.0 -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain,!sse-s3'"
2022-07-19T12:57:35.432 INFO:scrape:ceph version 17.0.0-13632-ge7710fc6 (e7710fc616d12b3ed8b3599e5c5214a022972a2a) quincy (dev)
 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f7db3e92ce0]
 2: gsignal()
 3: abort()
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b0) [0x7f7db2f54402]
 5: /usr/lib64/ceph/libceph-common.so.2(+0x2c15c5) [0x7f7db2f545c5]
 6: (std::__detail::__variant::__gen_vtable_impl<std::__detail::__variant::_Multi_array<int (*)(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError> const&)>, std::tuple<std::variant<std::monostate, InjectAbort, InjectError> const&>, std::integer_sequence<unsigned long, 1ul> >::__visit_invoke(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError> const&)+0x41) [0x5636d7e32411]
 7: radosgw-admin(+0x911f15) [0x5636d7e29f15]
 8: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, DoutPrefixProvider const*, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xe5) [0x5636d7e2e495]
 9: main()
 10: __libc_start_main()
 11: _start()
2022-07-19T12:57:35.432 INFO:scrape:15 jobs: ['6938026', '6938020', '6938022', '6938011', '6937992', '6938003', '6937984', '6938014', '6938001', '6937986', '6937989', '6938028', '6938010', '6937995', '6937997']
2022-07-19T12:57:35.433 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'tasks/{cls']
2022-07-19T12:57:35.433 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2022-07-19T12:57:35.438 INFO:scrape:
2022-07-19T12:57:35.439 INFO:scrape:Failure: Cannot create secret
2022-07-19T12:57:35.440 INFO:scrape:1 jobs: ['6937972']
2022-07-19T12:57:35.441 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'supported-random-distro$/{ubuntu_latest}}']
2022-07-19T12:57:35.442 INFO:scrape:
2022-07-19T12:57:35.443 INFO:scrape:Failure: rgw multisite test failures
2022-07-19T12:57:35.444 INFO:scrape:2 jobs: ['6937977', '6938007']
2022-07-19T12:57:35.445 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi}']
2022-07-19T12:57:35.446 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}']
2022-07-19T12:57:35.447 INFO:scrape:
2022-07-19T12:57:35.449 INFO:scrape:Failure: Command failed on smithi022 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'"
2022-07-19T12:57:35.450 INFO:scrape:1 jobs: ['6937981']
2022-07-19T12:57:35.451 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2022-07-19T12:57:35.453 INFO:scrape:
2022-07-19T12:57:35.454 INFO:scrape:Crash: Command failed on smithi141 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data'
2022-07-19T12:57:35.455 INFO:scrape:ceph version 17.0.0-13632-ge7710fc6 (e7710fc616d12b3ed8b3599e5c5214a022972a2a) quincy (dev)
 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f75d9623ce0]
 2: gsignal()
 3: abort()
 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x1b8) [0x7f75dbc18bc2]
 5: (MMonPaxos::print(std::ostream&) const+0x28d) [0x55ec095ca2ed]
 6: (DispatchQueue::pre_dispatch(boost::intrusive_ptr<Message> const&)+0x768) [0x7f75dbea3ce8]
 7: (DispatchQueue::entry()+0x105b) [0x7f75dbea5fbb]
 8: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75dbf5cdf1]
 9: /lib64/libpthread.so.0(+0x81ca) [0x7f75d96191ca]
 10: clone()
2022-07-19T12:57:35.455 INFO:scrape:1 jobs: ['6938017']
2022-07-19T12:57:35.456 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/valgrind}']
2022-07-19T12:57:35.457 INFO:scrape:
2022-07-19T12:57:35.459 INFO:scrape:Failure: {'smithi097.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': True, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failure downloading http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm, Request failed: <urlopen error [Errno 113] No route to host>'}}
2022-07-19T12:57:35.460 INFO:scrape:6 jobs: ['6938015', '6938008', '6937990', '6937973', '6937980', '6937998']
2022-07-19T12:57:35.461 INFO:scrape:suites intersection: []
2022-07-19T12:57:35.461 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/kmip', '2-kms/testing', '2-kms/vault_old', '3-rgw/rgw', '4-tests/{s3tests}', 'first', 'frontend/beast', 'ignore-pg-availability', 'objectstore', 'objectstore/filestore-xfs', 'overrides', 'pool-type', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/dbstore/{cluster', 'rgw/singleton/{all/radosgw-admin', 'rgw/sts/{cluster', 'rgw_frontend/beast', 'rgw_pool_type/ec-profile', 's3tests-branch', 'ststests}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/rgw_s3tests}', 'tasks/{0-install']
2022-07-19T12:57:35.462 INFO:scrape:
2022-07-19T12:57:35.462 INFO:scrape:Failure: 'iam'
2022-07-19T12:57:35.463 INFO:scrape:1 jobs: ['6937971']
2022-07-19T12:57:35.464 INFO:scrape:suites: ['overrides', 'rgw/cloud-transition/{cluster', 's3tests-branch', 'supported-random-distro$/{centos_8}', 'tasks/cloud_transition_s3tests}']
2022-07-19T12:57:35.464 INFO:scrape: