2020-05-04T14:36:43.548 INFO:root:teuthology version: 1.0.0-58684fc5
2020-05-04T14:36:43.550 INFO:teuthology.results:seed: '1588'
2020-05-04T15:27:03.949 INFO:root:teuthology version: 1.0.0-58684fc5
2020-05-04T15:27:03.972 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-05-05T02:57:20.041 INFO:teuthology.results:Tests finished! gathering results...
2020-05-05T02:57:20.498 INFO:teuthology.results:Sending results to ofriedma@redhat.com: Test Run: ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/
failed:  39
dead:    0
running: 0
waiting: 0
queued:  0
passed:  67


Fail
=================================================================
[5022026]  rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:09:08
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022026/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022026/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=247a68de8ded4d6da953ba5b1b986aa4

    Missing parentheses in call to 'print'. Did you mean
    print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line
    2747)

[5022031]  rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:17:13
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022031/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022031/

    "2020-05-04T14:56:28.011604+0000 mon.b (mon.0) 270 : cluster [WRN] Health
    check failed: Reduced data availability: 2 pgs inactive (PG_AVAILABILITY)"
    in cluster log

[5022032]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:16:35
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022032/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022032/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a564ddedd5624e04afb75ac1dd12eb72

    Command failed (workunit test rgw/run-reshard.sh) on smithi144 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022035]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:22:11
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022035/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022035/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=cdafb429636947e8861cc7c8440982ee

    Command failed (workunit test rgw/run-reshard.sh) on smithi103 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022037]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:23:13
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022037/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022037/

    "2020-05-04T15:11:25.973258+0000 mon.b (mon.0) 223 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)"
    in cluster log

[5022038]  rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml}
-----------------------------------------------------------------
time:   00:12:42
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022038/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022038/

    "2020-05-04T15:05:33.873713+0000 mon.b (mon.0) 167 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5022039]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:16:32
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022039/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022039/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=525c21731d02401b92cef415d81e2d15

    Command failed (workunit test rgw/run-reshard.sh) on smithi191 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022041]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:16:20
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022041/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022041/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a7aa2e0e4e254dba8f7fe0f05bf0b7a9

    Command failed (workunit test rgw/run-reshard.sh) on smithi051 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022046]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:16:40
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022046/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022046/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b64045427b384e7c8a227eab0b224e33

    Command failed (workunit test rgw/run-reshard.sh) on smithi152 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022049]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:16:20
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022049/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022049/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=f759b0519ad843389d41d7bfeba0c8bb

    Command failed (workunit test rgw/run-reshard.sh) on smithi096 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022053]  rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:09:08
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022053/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022053/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=03cc04d1be354d77a744113c61fab237

    Missing parentheses in call to 'print'. Did you mean
    print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line
    2747)

[5022055]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:23:11
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022055/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022055/

    "2020-05-04T15:21:35.161940+0000 mon.b (mon.0) 397 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)"
    in cluster log

[5022057]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:17:00
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022057/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022057/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=3787d4f562e643ca8393f7e115297e7b

    Command failed (workunit test rgw/run-reshard.sh) on smithi130 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022058]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   11:54:55
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022058/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022058/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=8565c1dde3c54ec398fde79457162edc

    psutil.NoSuchProcess process no longer exists (pid=18170)

[5022060]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:17:13
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022060/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022060/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=eb54a86ab1884acbbef370e57c24f37e

    Command failed (workunit test rgw/run-reshard.sh) on smithi168 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022064]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:17:07
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022064/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022064/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=735bec4f432746aba276f6aadf72dc67

    Command failed (workunit test rgw/run-reshard.sh) on smithi040 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022067]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:15:23
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022067/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022067/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=f85de2e540c24b929836d8d63a2305d9

    Command failed (workunit test rgw/run-reshard.sh) on smithi110 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022070]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:15:26
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022070/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022070/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=0f5713dd8e3c4afea2d2888257d19f6b

    Command failed (workunit test rgw/run-reshard.sh) on smithi165 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022073]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:16:26
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022073/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022073/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=83278b8664e741c79264e30951244a6a

    Command failed (workunit test rgw/run-reshard.sh) on smithi062 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022079]  rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:08:50
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022079/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022079/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=cf527404c4c24dd5bc5a7ab7223bb972

    Missing parentheses in call to 'print'. Did you mean
    print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line
    2747)

[5022085]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:17:31
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022085/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022085/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=89373efc280b4e97a0670580eaaac200

    Command failed (workunit test rgw/run-reshard.sh) on smithi014 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022087]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:21:47
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022087/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022087/

    "2020-05-04T15:21:31.081821+0000 mon.b (mon.0) 234 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5022088]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:16:52
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022088/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022088/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9ab4ab1e57ea43eba34b50ce00851660

    Command failed (workunit test rgw/run-reshard.sh) on smithi050 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022092]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:16:23
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022092/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022092/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1fd029e684a143649e3b4d93aae7b949

    Command failed (workunit test rgw/run-reshard.sh) on smithi117 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022094]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:16:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022094/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022094/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9ee73872281b42aab8d1f2c96c03e5c9

    Command failed (workunit test rgw/run-reshard.sh) on smithi051 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022095]  rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml}
-----------------------------------------------------------------
time:   00:08:15
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022095/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022095/

    "2020-05-04T15:22:30.721290+0000 mon.a (mon.0) 175 : cluster [WRN] Health
    check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5022099]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:15:58
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022099/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022099/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=665b86665b78463d97bdfec020545a38

    Command failed (workunit test rgw/run-reshard.sh) on smithi123 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022100]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:23:32
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022100/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022100/

    "2020-05-04T15:31:29.865569+0000 mon.a (mon.0) 335 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5022102]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:16:08
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022102/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022102/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=082e3f8f11484113ad1f14f26c82b175

    Command failed (workunit test rgw/run-reshard.sh) on smithi183 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022106]  rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml}
-----------------------------------------------------------------
time:   00:08:55
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022106/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022106/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=97daf4b204f749caa4bca28020ce6174

    Missing parentheses in call to 'print'. Did you mean
    print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line
    2747)

[5022110]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:17:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022110/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022110/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=121785a3aa884902b2acefb60387d50e

    Command failed (workunit test rgw/run-reshard.sh) on smithi096 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022113]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:17:08
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022113/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022113/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=97edaa1266e948ecb55db663d48cc587

    Command failed (workunit test rgw/run-reshard.sh) on smithi119 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022114]  rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml}
-----------------------------------------------------------------
time:   00:09:08
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022114/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022114/

    "2020-05-04T15:35:19.818493+0000 mon.b (mon.0) 251 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5022117]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:17:05
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022117/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022117/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a2e7907c46d64e5198a541d61d7e2796

    Command failed (workunit test rgw/run-reshard.sh) on smithi134 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022120]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:15:23
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022120/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022120/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9cb8bc7c72e045efbe146db3b68aeac0

    Command failed (workunit test rgw/run-reshard.sh) on smithi129 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022122]  rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml}
-----------------------------------------------------------------
time:   00:08:11
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022122/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022122/

    "2020-05-04T15:37:48.105025+0000 mon.a (mon.0) 181 : cluster [WRN] Health
    check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5022123]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:16:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022123/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022123/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7c58d128fec943efa0c947f0d132c90c

    Command failed (workunit test rgw/run-reshard.sh) on smithi047 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022126]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:15:44
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022126/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022126/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=42dd0bc8eb7d44778d26c8d1379d12cf

    Command failed (workunit test rgw/run-reshard.sh) on smithi107 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=639f79d822f83767cebf244501aacdd249234271
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[5022128]  rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:24:51
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022128/
log:    http://qa-proxy.ceph.com/teuthology/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022128/

    "2020-05-04T15:55:59.460580+0000 mon.a (mon.0) 169 : cluster [WRN] Health
    check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering
    (PG_AVAILABILITY)" in cluster log



Pass
=================================================================
[5022023] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:18:54
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022023/

[5022024] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml overrides.yaml s3a-hadoop.yaml}
time:   00:15:14
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022024/

[5022025] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml}
time:   00:09:28
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022025/

[5022027] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:12:34
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022027/

[5022028] rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml}
time:   00:20:02
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022028/

[5022029] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml}
time:   00:12:44
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022029/

[5022030] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:22:36
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022030/

[5022033] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml}
time:   00:08:22
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022033/

[5022034] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:23:11
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022034/

[5022036] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml}
time:   00:08:32
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022036/

[5022040] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml}
time:   00:11:10
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022040/

[5022042] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml}
time:   00:08:39
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022042/

[5022043] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:23:34
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022043/

[5022044] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml}
time:   00:09:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022044/

[5022045] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:12:13
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022045/

[5022047] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:29:25
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022047/

[5022048] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml}
time:   00:08:49
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022048/

[5022050] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:24:09
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022050/

[5022051] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml}
time:   00:08:14
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022051/

[5022052] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:12:01
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022052/

[5022054] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml}
time:   00:17:35
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022054/

[5022056] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml}
time:   00:13:23
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022056/

[5022059] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml}
time:   00:08:05
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022059/

[5022061] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml}
time:   00:09:35
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022061/

[5022062] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}}
time:   00:10:02
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022062/

[5022063] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:22:38
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022063/

[5022065] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml}
time:   00:08:15
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022065/

[5022066] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml}
time:   00:11:37
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022066/

[5022068] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:22:58
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022068/

[5022069] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml}
time:   00:08:51
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022069/

[5022071] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml}
time:   00:12:39
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022071/

[5022072] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:24:03
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022072/

[5022074] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml}
time:   00:08:34
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022074/

[5022075] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:24:00
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022075/

[5022076] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:12:25
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022076/

[5022077] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml overrides.yaml s3a-hadoop.yaml}
time:   00:14:27
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022077/

[5022078] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml}
time:   00:09:12
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022078/

[5022080] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}}
time:   00:09:46
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022080/

[5022081] rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml}
time:   00:19:15
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022081/

[5022082] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml}
time:   00:12:42
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022082/

[5022083] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:22:27
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022083/

[5022084] rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml}
time:   00:16:52
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022084/

[5022086] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml}
time:   00:08:41
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022086/

[5022089] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml}
time:   00:08:12
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022089/

[5022090] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:22:31
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022090/

[5022091] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml}
time:   00:13:42
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022091/

[5022093] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml}
time:   00:11:09
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022093/

[5022096] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:22:14
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022096/

[5022097] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml}
time:   00:09:33
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022097/

[5022098] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:12:17
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022098/

[5022101] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml}
time:   00:08:16
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022101/

[5022103] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:24:13
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022103/

[5022104] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml}
time:   00:08:37
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022104/

[5022105] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}}
time:   00:12:25
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022105/

[5022107] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml}
time:   00:17:30
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022107/

[5022108] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:23:00
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022108/

[5022109] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml}
time:   00:12:32
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022109/

[5022111] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:21:32
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022111/

[5022112] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml}
time:   00:08:28
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022112/

[5022115] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{rhel_8.yaml}}
time:   00:12:09
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022115/

[5022116] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}
time:   00:21:59
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022116/

[5022118] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml}
time:   00:08:47
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022118/

[5022119] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml}
time:   00:12:06
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022119/

[5022121] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:29:10
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022121/

[5022124] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml}
time:   00:14:09
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022124/

[5022125] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}
time:   00:24:25
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022125/

[5022127] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml}
time:   00:08:06
info:   http://pulpito.ceph.com/ofriedma-2020-05-04_14:36:02-rgw-rgw_swift_404_anon_i02-distro-basic-smithi/5022127/
2020-05-05T02:57:20.596 INFO:teuthology.results:starting coverage generation
2020-05-05T02:57:20.608 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'