2020-07-06T07:49:33.391 INFO:root:teuthology version: 1.0.0-2b31d02
2020-07-06T07:49:33.392 INFO:teuthology.results:subset: '1/3'
2020-07-06T07:49:33.393 INFO:teuthology.results:seed: '0'
2020-07-06T08:21:36.120 INFO:root:teuthology version: 1.0.0-2b31d02
2020-07-06T08:21:36.164 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-07-06T09:11:37.306 INFO:teuthology.results:Tests finished! gathering results...
2020-07-06T09:11:40.764 INFO:scrape:Found 55 jobs
2020-07-06T09:12:07.356 INFO:scrape:Found 7 distinct failure reasons
2020-07-06T09:12:07.358 INFO:scrape:Failure: "2020-07-06T08:13:58.196960+0000 mon.a (mon.0) 127 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log
2020-07-06T09:12:07.359 INFO:scrape:3 jobs: ['5202751', '5202768', '5202731']
2020-07-06T09:12:07.359 INFO:scrape:suites intersection: ['overrides']
2020-07-06T09:12:07.360 INFO:scrape:suites union: ['frontend/civetweb', 'hadoop/default', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 's3a-hadoop}', 'tasks/rgw_multipart_upload}', 'tasks/rgw_s3tests}']
2020-07-06T09:12:07.360 INFO:scrape:
2020-07-06T09:12:07.360 INFO:scrape:Failure: Command failed on smithi168 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi168.front.sepia.ceph.com:35357/v3 --description 'Encryption Tenant' --domain default rgwcrypt --debug"
2020-07-06T09:12:07.361 INFO:scrape:3 jobs: ['5202730', '5202735', '5202763']
2020-07-06T09:12:07.361 INFO:scrape:suites intersection: []
2020-07-06T09:12:07.362 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'frontend/beast', 'frontend/civetweb', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2020-07-06T09:12:07.362 INFO:scrape:
2020-07-06T09:12:07.362 INFO:scrape:Failure: Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi162 with status 12: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7a1d6ce657520827eabe28f54f71d069c9f320e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh'
2020-07-06T09:12:07.363 INFO:scrape:1 jobs: ['5202737']
2020-07-06T09:12:07.363 INFO:scrape:suites: ['cluster', 'rgw/tools/{centos_latest', 'tasks}']
2020-07-06T09:12:07.364 INFO:scrape:
2020-07-06T09:12:07.364 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi068 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain'"
2020-07-06T09:12:07.364 INFO:scrape:11 jobs: ['5202784', '5202782', '5202740', '5202750', '5202779', '5202770', '5202745', '5202738', '5202777', '5202772', '5202767']
2020-07-06T09:12:07.365 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 's3tests-java', 's3tests}', 'tasks/{0-install']
2020-07-06T09:12:07.366 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}']
2020-07-06T09:12:07.366 INFO:scrape:
2020-07-06T09:12:07.366 INFO:scrape:Failure: rgw multisite, test failures
2020-07-06T09:12:07.367 INFO:scrape:3 jobs: ['5202748', '5202733', '5202775']
2020-07-06T09:12:07.367 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2020-07-06T09:12:07.368 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2020-07-06T09:12:07.368 INFO:scrape:
2020-07-06T09:12:07.368 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean.
2020-07-06T09:12:07.369 INFO:scrape:6 jobs: ['5202765', '5202764', '5202743', '5202755', '5202776', '5202769']
2020-07-06T09:12:07.369 INFO:scrape:suites intersection: ['clusters/fixed-2']
2020-07-06T09:12:07.370 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'install', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/thrash/{civetweb', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'thrasher/default', 'thrashosds-health', 'validater/lockdep}', 'workload/rgw_bucket_quota}', 'workload/rgw_multipart_upload}', 'workload/rgw_s3tests}']
2020-07-06T09:12:07.370 INFO:scrape:
2020-07-06T09:12:07.371 INFO:scrape:Failure: {'Failure object was': {'smithi134.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Connection failure: timed out', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"}
2020-07-06T09:12:07.371 INFO:scrape:1 jobs: ['5202754']
2020-07-06T09:12:07.371 INFO:scrape:suites: ['clusters/fixed-2', 'install', 'objectstore/filestore-xfs', 'rgw/thrash/{civetweb', 'thrasher/default', 'thrashosds-health', 'workload/rgw_user_quota}']
2020-07-06T09:12:07.372 INFO:scrape: