2020-04-08T07:23:07.286 INFO:root:teuthology version: 1.0.0-0f93372
2020-04-08T07:23:07.286 INFO:teuthology.results:subset: '804/9999'
2020-04-08T07:23:07.287 INFO:teuthology.results:seed: '2477'
2020-04-08T08:27:54.220 INFO:root:teuthology version: 1.0.0-0f93372
2020-04-08T08:27:54.250 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-04-08T09:17:55.200 INFO:teuthology.results:Tests finished! gathering results...
2020-04-08T09:17:55.271 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/
failed:  3
dead:    0
running: 0
waiting: 0
queued:  0
passed:  35


Fail
=================================================================
[4934663]  rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:24:50
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934663/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934663/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=8e7ef27450d0423e9433b54c9b96d843

    rgw multisite, test failures

[4934658]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:10:42
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934658/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934658/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a05d241f43fc4ce58c4e5d0db6d35df7

    ssl: ca root not found for certificate rgw.client.0

[4934677]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:10:23
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934677/
log:    http://qa-proxy.ceph.com/teuthology/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934677/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2d389c828bff46bab8533a6a69014c07

    ssl: ca root not found for certificate rgw.client.0



Pass
=================================================================
[4934652] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml s3a-hadoop.yaml}
time:   00:15:52
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934652/

[4934653] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml}
time:   00:38:52
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934653/

[4934650] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml}
time:   00:09:57
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934650/

[4934651] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:19:57
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934651/

[4934656] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml}
time:   00:14:09
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934656/

[4934657] rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml}
time:   00:18:20
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934657/

[4934654] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:11:22
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934654/

[4934655] rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml}
time:   00:21:05
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934655/

[4934659] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml}
time:   00:10:31
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934659/

[4934678] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml}
time:   00:15:39
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934678/

[4934679] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml}
time:   00:12:59
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934679/

[4934670] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:13:50
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934670/

[4934671] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml s3a-hadoop.yaml}
time:   00:15:12
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934671/

[4934672] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml}
time:   00:40:53
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934672/

[4934673] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:11:54
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934673/

[4934674] rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml}
time:   00:20:47
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934674/

[4934675] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml}
time:   00:15:03
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934675/

[4934676] rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml}
time:   00:18:44
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934676/

[4934684] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml}
time:   00:08:44
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934684/

[4934647] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:23:08
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934647/

[4934681] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:14:11
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934681/

[4934680] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:11:27
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934680/

[4934683] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml}
time:   00:18:40
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934683/

[4934682] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml}
time:   00:23:40
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934682/

[4934649] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml}
time:   00:12:33
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934649/

[4934648] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:15:56
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934648/

[4934669] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml}
time:   00:09:36
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934669/

[4934668] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml}
time:   00:12:51
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934668/

[4934662] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:13:39
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934662/

[4934661] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:11:01
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934661/

[4934660] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml}
time:   00:12:31
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934660/

[4934667] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:11:52
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934667/

[4934666] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:25:31
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934666/

[4934665] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml}
time:   00:10:02
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934665/

[4934664] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml}
time:   00:19:25
info:   http://pulpito.ceph.com/kchai-2020-04-08_07:22:38-rgw-wip-kefu-testing-2020-04-08-1234-distro-basic-smithi/4934664/
2020-04-08T09:17:55.422 INFO:teuthology.results:starting coverage generation
2020-04-08T09:17:55.440 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python2.7/subprocess.py", line 711, in __init__
    errread, errwrite)
  File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child
    raise child_exception
OSError: [Errno 2] No such file or directory