2020-05-17T13:50:10.129 INFO:root:teuthology version: 1.0.0-437df57
2020-05-17T13:50:10.131 INFO:teuthology.results:seed: '5862'
2020-05-17T14:42:02.439 INFO:root:teuthology version: 1.0.0-437df57
2020-05-17T14:42:02.453 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-05-18T02:13:18.464 INFO:teuthology.results:Tests finished! gathering results...
2020-05-18T02:13:18.636 INFO:teuthology.results:Sending results to ofriedma@redhat.com: Test Run: ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/
failed:  28
dead:    1
running: 0
waiting: 0
queued:  0
passed:  78


Fail
=================================================================
[5063338]  rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
-----------------------------------------------------------------
time:   00:10:35
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063338/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063338/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a662a1cbd71a4cdf8535917a753502ca

    Command failed on smithi148 with status 1: 'cd
    /home/ubuntu/cephtest/keystone && source /home/ubuntu/cephtest/tox-
    venv/bin/activate && tox -e venv --notest'

[5063341]  rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:40:48
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063341/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063341/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=de462bd91f11458abb86819528301665

    rgw multisite, test failures

[5063343]  rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:19:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063343/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063343/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1dfa1040cdff4f1bb929ad6a2a92cdb9

    Command failed on smithi158 with status 1: 'cd
    /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e
    venv --notest'

[5063345]  rgw/tools/{centos_latest.yaml cluster.yaml tasks.yaml}
-----------------------------------------------------------------
time:   00:14:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063345/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063345/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b02542b4d1e14949863af08ca336059c

    Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi163
    with status 12: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=6b217d8b7fcdc477943027efe7b58cc6f9b8addb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh'

[5063346]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:27:26
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063346/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063346/

    "2020-05-17T14:09:13.086584+0000 mon.a (mon.0) 440 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063347]  rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:11:18
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063347/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063347/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=3be5ba2001264fc299cfbb1ee83ff2fb

    Command failed on smithi007 with status 2: 'cd
    /home/ubuntu/cephtest/s3-tests && ./bootstrap'

[5063353]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:28:28
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063353/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063353/

    "2020-05-17T14:05:57.482433+0000 mon.a (mon.0) 212 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063364]  rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml}
-----------------------------------------------------------------
time:   00:10:42
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063364/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063364/

    "2020-05-17T14:05:10.237774+0000 mon.b (mon.0) 173 : cluster [WRN] Health
    check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063369]  rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:28:12
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063369/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063369/

    "2020-05-17T14:05:26.900440+0000 mon.a (mon.0) 207 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063374]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:27:57
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063374/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063374/

    "2020-05-17T14:02:37.626748+0000 mon.b (mon.0) 155 : cluster [WRN] Health
    check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063376]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:31:04
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063376/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063376/

    "2020-05-17T14:04:53.517565+0000 mon.b (mon.0) 258 : cluster [WRN] Health
    check failed: Reduced data availability: 8 pgs inactive, 8 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063384]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:27:35
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063384/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063384/

    "2020-05-17T14:37:06.387614+0000 mon.b (mon.0) 153 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063388]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:28:38
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063388/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063388/

    "2020-05-17T14:24:24.533969+0000 mon.b (mon.0) 379 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063391]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:25:36
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063391/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063391/

    "2020-05-17T14:33:11.791538+0000 mon.a (mon.0) 166 : cluster [WRN] Health
    check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063392]  rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
-----------------------------------------------------------------
time:   00:13:57
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063392/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063392/

    "2020-05-17T14:20:03.501715+0000 mon.a (mon.0) 161 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063395]  rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:43:46
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063395/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063395/

    "2020-05-17T14:25:42.190680+0000 mon.a (mon.0) 215 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 3 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063396]  rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}}
-----------------------------------------------------------------
time:   00:10:29
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063396/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063396/

    "2020-05-17T14:27:46.777710+0000 mon.a (mon.0) 153 : cluster [WRN] Health
    check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063400]  rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:10:52
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063400/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063400/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=21a84ae507a5421eaffcf7f9c4f60bdd

    Command failed on smithi099 with status 2: 'cd
    /home/ubuntu/cephtest/s3-tests && ./bootstrap'

[5063410]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:29:45
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063410/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063410/

    "2020-05-17T14:38:04.875659+0000 mon.b (mon.0) 168 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063415]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:28:59
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063415/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063415/

    "2020-05-17T14:40:22.641651+0000 mon.b (mon.0) 154 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063418]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:28:38
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063418/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063418/

    "2020-05-17T14:39:53.563709+0000 mon.b (mon.0) 164 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063422]  rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:26:10
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063422/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063422/

    "2020-05-17T14:59:23.500939+0000 mon.a (mon.0) 206 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063426]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:28:20
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063426/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063426/

    "2020-05-17T14:52:22.462340+0000 mon.a (mon.0) 195 : cluster [WRN] Health
    check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063433]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:28:23
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063433/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063433/

    "2020-05-17T14:57:00.833073+0000 mon.b (mon.0) 165 : cluster [WRN] Health
    check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5063437]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:27:18
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063437/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063437/

    "2020-05-17T14:50:38.868580+0000 mon.b (mon.0) 165 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063441]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:28:08
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063441/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063441/

    "2020-05-17T14:59:26.629569+0000 mon.a (mon.0) 398 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5063442]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:29:49
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063442/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063442/

    "2020-05-17T15:11:20.149166+0000 mon.a (mon.0) 539 : cluster [WRN] Health
    check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

[5063444]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:26:22
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063444/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063444/

    "2020-05-17T14:57:29.527081+0000 mon.b (mon.0) 149 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log



Dead
=================================================================
[5063397]  rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063397/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063397/



Pass
=================================================================
[5063339] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml overrides.yaml s3a-hadoop.yaml}
time:   00:16:06
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063339/

[5063340] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml}
time:   00:10:11
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063340/

[5063342] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:10:39
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063342/

[5063344] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml}
time:   00:14:50
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063344/

[5063348] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:29:52
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063348/

[5063349] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml}
time:   00:08:56
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063349/

[5063350] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:28:36
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063350/

[5063351] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:36:25
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063351/

[5063352] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml}
time:   00:10:17
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063352/

[5063354] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml}
time:   00:14:12
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063354/

[5063355] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:28:11
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063355/

[5063356] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml}
time:   00:12:44
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063356/

[5063357] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:30:19
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063357/

[5063358] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml}
time:   00:10:17
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063358/

[5063359] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:28:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063359/

[5063360] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml}
time:   00:10:51
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063360/

[5063361] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:14:00
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063361/

[5063362] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:28:52
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063362/

[5063363] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:27:30
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063363/

[5063365] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:29:36
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063365/

[5063366] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:27:37
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063366/

[5063367] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml}
time:   00:08:55
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063367/

[5063368] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:13:33
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063368/

[5063370] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml}
time:   00:23:18
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063370/

[5063371] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:27:32
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063371/

[5063372] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml}
time:   00:15:21
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063372/

[5063373] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:30:42
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063373/

[5063375] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml}
time:   00:09:57
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063375/

[5063377] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml}
time:   00:10:39
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063377/

[5063378] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:10:33
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063378/

[5063379] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:28:11
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063379/

[5063380] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:31:06
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063380/

[5063381] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml}
time:   00:10:09
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063381/

[5063382] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml}
time:   00:12:51
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063382/

[5063383] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:29:06
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063383/

[5063385] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml}
time:   00:10:18
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063385/

[5063386] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:34:31
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063386/

[5063387] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml}
time:   00:14:04
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063387/

[5063389] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:28:04
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063389/

[5063390] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml}
time:   00:09:16
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063390/

[5063393] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml overrides.yaml s3a-hadoop.yaml}
time:   00:13:54
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063393/

[5063394] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml}
time:   00:09:53
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063394/

[5063398] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml}
time:   00:13:31
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063398/

[5063399] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:26:52
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063399/

[5063401] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:27:55
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063401/

[5063402] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml}
time:   00:09:30
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063402/

[5063403] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:27:20
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063403/

[5063404] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:27:18
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063404/

[5063405] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml}
time:   00:08:57
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063405/

[5063406] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:27:14
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063406/

[5063407] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml}
time:   00:15:14
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063407/

[5063408] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:30:44
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063408/

[5063409] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml}
time:   00:13:17
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063409/

[5063411] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml}
time:   00:09:02
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063411/

[5063412] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:26:10
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063412/

[5063413] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml}
time:   00:10:16
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063413/

[5063414] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:10:47
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063414/

[5063416] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:27:38
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063416/

[5063417] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml}
time:   00:09:02
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063417/

[5063419] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:31:07
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063419/

[5063420] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml}
time:   00:09:45
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063420/

[5063421] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:13:52
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063421/

[5063423] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml}
time:   00:18:08
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063423/

[5063424] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:27:14
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063424/

[5063425] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml}
time:   00:13:48
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063425/

[5063427] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:26:10
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063427/

[5063428] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml}
time:   00:09:17
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063428/

[5063429] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:28:40
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063429/

[5063430] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml}
time:   00:10:26
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063430/

[5063431] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:13:09
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063431/

[5063432] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:32:50
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063432/

[5063434] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml}
time:   00:09:20
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063434/

[5063435] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml}
time:   00:13:12
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063435/

[5063436] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:28:12
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063436/

[5063438] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml}
time:   00:09:00
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063438/

[5063439] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:29:41
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063439/

[5063440] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml}
time:   00:15:21
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063440/

[5063443] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml}
time:   00:09:02
info:   http://pulpito.ceph.com/ofriedma-2020-05-17_13:23:36-rgw-fix-rgw-multipart-abortdate-i10-distro-basic-smithi/5063443/
2020-05-18T02:13:18.812 INFO:teuthology.results:starting coverage generation
2020-05-18T02:13:18.826 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'