2020-09-11T08:36:17.660 INFO:root:teuthology version: 1.0.0-55bd2dc
2020-09-11T08:36:17.662 INFO:teuthology.results:subset: '1/3'
2020-09-11T08:36:17.662 INFO:teuthology.results:seed: '0'
2020-09-11T08:58:31.775 INFO:root:teuthology version: 1.0.0-55bd2dc
2020-09-11T08:58:32.745 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-09-11T09:41:33.583 INFO:teuthology.results:Tests finished! gathering results...
2020-09-11T09:41:43.615 INFO:scrape:Found 55 jobs
2020-09-11T09:41:56.164 INFO:scrape:Found 8 distinct failure reasons
2020-09-11T09:41:56.165 INFO:scrape:Failure: Command failed on smithi129 with status 2: "adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0813425365 --totp-seed YNU4EHFMNW55RTJ4X27TTAUI5VI5MFBFHB6FOCSEAPMX463OF44ONEIQDIG57WAG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph"
2020-09-11T09:41:56.166 INFO:scrape:8 jobs: ['5421590', '5421621', '5421609', '5421617', '5421594', '5421582', '5421601', '5421619']
2020-09-11T09:41:56.166 INFO:scrape:suites intersection: []
2020-09-11T09:41:56.167 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}}', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'http', 'install', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multifs/{clusters/fixed-2', 'rgw/thrash/{civetweb', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'tasks/rgw_s3tests}', 'tasks/s3tests-website', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest}', 'workload/rgw_s3tests}']
2020-09-11T09:41:56.168 INFO:scrape:
2020-09-11T09:41:56.168 INFO:scrape:Failure: Command failed (ragweed tests against rgw) on smithi104 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"
2020-09-11T09:41:56.169 INFO:scrape:16 jobs: ['5421588', '5421583', '5421625', '5421595', '5421598', '5421608', '5421622', '5421613', '5421610', '5421615', '5421620', '5421616', '5421627', '5421589', '5421581', '5421586']
2020-09-11T09:41:56.170 INFO:scrape:suites intersection: ['overrides']
2020-09-11T09:41:56.170 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/multifs/{clusters/fixed-2', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/rgw_ragweed}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}']
2020-09-11T09:41:56.171 INFO:scrape:
2020-09-11T09:41:56.171 INFO:scrape:Failure: rgw multisite, test failures
2020-09-11T09:41:56.172 INFO:scrape:4 jobs: ['5421591', '5421618', '5421604', '5421576']
2020-09-11T09:41:56.173 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2020-09-11T09:41:56.173 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2020-09-11T09:41:56.174 INFO:scrape:
2020-09-11T09:41:56.174 INFO:scrape:Failure: Command failed on smithi109 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'"
2020-09-11T09:41:56.175 INFO:scrape:2 jobs: ['5421578', '5421606']
2020-09-11T09:41:56.175 INFO:scrape:suites intersection: ['overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2020-09-11T09:41:56.176 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2020-09-11T09:41:56.176 INFO:scrape:
2020-09-11T09:41:56.176 INFO:scrape:Failure: Command failed on smithi140 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'
2020-09-11T09:41:56.177 INFO:scrape:1 jobs: ['5421600']
2020-09-11T09:41:56.177 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'tasks/{0-install', 'validater/valgrind}']
2020-09-11T09:41:56.178 INFO:scrape:
2020-09-11T09:41:56.179 INFO:scrape:Failure: {'Failure object was': {'smithi003.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/qemu-kvm-block-rbd-2.12.0-88.module_el8.1.0+297+df420408.3.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"}
2020-09-11T09:41:56.179 INFO:scrape:1 jobs: ['5421593']
2020-09-11T09:41:56.180 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'frontend/beast', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}']
2020-09-11T09:41:56.180 INFO:scrape:
2020-09-11T09:41:56.181 INFO:scrape:Failure: Command failed on smithi008 with status 2: "adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 4134012143 --totp-seed GM2JIUKYQ7DU6QW4L33LOIXFLYYLVNYLCLASPJQPEO4J5EKMQB5SRRJEB6VIKYMC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph"
2020-09-11T09:41:56.181 INFO:scrape:1 jobs: ['5421592']
2020-09-11T09:41:56.182 INFO:scrape:suites: ['clusters/fixed-2', 'install', 'objectstore/bluestore-bitmap', 'rgw/thrash/{civetweb', 'thrasher/default', 'thrashosds-health', 'workload/rgw_s3tests}']
2020-09-11T09:41:56.183 INFO:scrape:
2020-09-11T09:41:56.183 INFO:scrape:Failure: Cannot create secret
2020-09-11T09:41:56.184 INFO:scrape:1 jobs: ['5421573']
2020-09-11T09:41:56.184 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1']
2020-09-11T09:41:56.185 INFO:scrape: