2020-05-06T20:54:27.756 INFO:root:teuthology version: 1.0.0-422bddb5 2020-05-06T20:54:27.757 INFO:teuthology.results:subset: '1/20' 2020-05-06T20:54:27.758 INFO:teuthology.results:seed: '839' 2020-05-06T21:22:45.283 INFO:root:teuthology version: 1.0.0-422bddb5 2020-05-06T21:22:45.319 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-06T22:11:46.220 INFO:teuthology.results:Tests finished! gathering results... 2020-05-06T22:11:46.309 INFO:teuthology.results:Sending results to ivancich@redhat.com: Test Run: ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/ failed: 22 dead: 0 running: 0 waiting: 0 queued: 0 passed: 13 Fail ================================================================= [5028740] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} ----------------------------------------------------------------- time: 00:55:02 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028740/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028740/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4e04294923c440ffabcf1a9d2c12f636 Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' [5028743] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:28:28 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028743/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028743/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7fc9a09349944d37b9ffca7b78da2bc6 rgw multisite, rgw multisite pubsub, test failures [5028744] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028744/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028744/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=34372ac0b073441b8fafd1cdbe5d6e2d [Errno 111] Connection refused [5028745] rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:36:43 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028745/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028745/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3d2fe86e0a9c445d8b663d832bce3cbf Command failed on smithi154 with status 1: 'cd /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e venv --notest' [5028747] rgw/tools/{centos_latest.yaml cluster.yaml tasks.yaml} ----------------------------------------------------------------- time: 00:14:26 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028747/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028747/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5f2604146b4f4640aa970f672a615c0f Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi158 with status 12: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=23b8ff01a1d0df2aca5ee4fa74d6ed9f29976e2e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh' [5028748] rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:10:48 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028748/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028748/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=92f724e2d2f04cd39de398c18849a67f Command failed on smithi095 with status 2: 'cd /home/ubuntu/cephtest/s3-tests && ./bootstrap' [5028750] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} ----------------------------------------------------------------- time: 00:11:32 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028750/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028750/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=66a8fd3109af443c983e825e22ce6fde Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data' [5028751] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:10:39 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028751/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028751/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=aed46a108e3349efa0c0d01d90140c83 [Errno 111] Connection refused [5028752] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} ----------------------------------------------------------------- time: 00:48:47 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028752/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028752/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=99e0ec1f3efe4d1fbcc4e201beaed6b9 Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' [5028753] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:28:53 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028753/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028753/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0beae6ee43db48a096be85af74383496 rgw multisite, rgw multisite pubsub, test failures [5028755] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} ----------------------------------------------------------------- time: 00:47:31 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028755/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028755/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=70d4ddab9b994b2589ad7d3ded2aab97 Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' [5028756] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:09:17 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028756/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028756/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ef0f348aa6534329bcfef8d3c1e58b00 [Errno 111] Connection refused [5028758] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} ----------------------------------------------------------------- time: 00:49:11 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028758/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028758/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bd9d92f411bc4379b7f92544ab3d808c Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' [5028761] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:30:05 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028761/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028761/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a0685637f6e74e618d375f290c4b7c2f rgw multisite, rgw multisite pubsub, test failures [5028762] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:09:51 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028762/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028762/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=115ab38ec864447f88e3966285df5955 [Errno 111] Connection refused [5028763] rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:19:33 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028763/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028763/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=31a3d24cd3b444ae918aca93ae9607c5 Command failed on smithi180 with status 1: 'cd /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e venv --notest' [5028765] rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:12:14 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028765/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028765/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6dead65316da40bfa4c814893ef3c222 Command failed on smithi101 with status 2: 'cd /home/ubuntu/cephtest/s3-tests && ./bootstrap' [5028767] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} ----------------------------------------------------------------- time: 00:11:01 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028767/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028767/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b38f551ffdc24ff5ad43cf95380ca21b Command failed (workunit test rgw/s3_bucket_quota.pl) on smithi191 with status 111: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=23b8ff01a1d0df2aca5ee4fa74d6ed9f29976e2e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl' [5028768] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_8.yaml}} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028768/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028768/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4060694f493f4e86900a27b9abe681e3 [Errno 111] Connection refused [5028769] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} ----------------------------------------------------------------- time: 00:43:46 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028769/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028769/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=95679f39e3254cc1b783e80c137d421a Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' [5028770] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:26:59 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028770/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028770/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=315711845a1f46e294475f695f5d7440 rgw multisite, rgw multisite pubsub, test failures [5028773] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}} ----------------------------------------------------------------- time: 00:09:40 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028773/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028773/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ece4b626502e43c5b528a142bce13339 [Errno 111] Connection refused Pass ================================================================= [5028739] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:17:08 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028739/ [5028741] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml overrides.yaml s3a-hadoop.yaml} time: 00:19:54 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028741/ [5028742] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} time: 00:13:26 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028742/ [5028746] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:17:02 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028746/ [5028749] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:12:17 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028749/ [5028754] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:21:14 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028754/ [5028757] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:14:37 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028757/ [5028759] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml overrides.yaml s3a-hadoop.yaml} time: 00:16:56 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028759/ [5028760] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} time: 00:12:45 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028760/ [5028764] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:13:27 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028764/ [5028766] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:14:29 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028766/ [5028771] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:19:26 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028771/ [5028772] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} time: 00:09:32 info: http://pulpito.ceph.com/ivancich-2020-05-06_20:35:08-rgw-wip-eric-testing-distro-basic-smithi/5028772/ 2020-05-06T22:11:46.455 INFO:teuthology.results:starting coverage generation 2020-05-06T22:11:46.462 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'