2019-10-26T21:12:08.457 INFO:root:teuthology version: 1.0.0-5052ff0
2019-10-26T21:12:08.458 INFO:teuthology.results:seed: '1283'
2019-10-26T21:40:35.020 INFO:root:teuthology version: 1.0.0-5052ff0
2019-10-26T21:40:35.053 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2019-10-27T09:40:46.836 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2019-10-27T09:40:46.939 INFO:teuthology.results:Sending results to yuvalif@yahoo.com: Test Run: yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/
failed:  34
dead:    14
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[4448221]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   07:55:09
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448221/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448221/

    saw valgrind issues

[4448201]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   01:40:44
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448201/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448201/

    Command failed on smithi183 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448225]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   01:04:15
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448225/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448225/

    Command failed (ragweed tests against rgw) on smithi083 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[4448197]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   03:35:37
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448197/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448197/

    Command failed on smithi198 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests ObjectTest'

[4448182]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   02:48:56
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448182/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448182/

    Command failed on smithi170 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448181]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   10:31:41
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448181/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448181/

    saw valgrind issues

[4448186]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   02:28:36
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448186/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448186/

    Command failed on smithi059 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448187]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   11:20:11
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448187/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448187/

    saw valgrind issues

[4448184]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   02:13:26
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448184/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448184/

    Command failed on smithi049 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448185]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   01:42:33
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448185/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448185/

    Command failed on smithi027 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448216]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   01:37:53
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448216/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448216/

    Command failed on smithi047 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448217]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   07:58:52
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448217/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448217/

    saw valgrind issues

[4448214]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   01:32:21
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448214/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448214/

    Command failed on smithi129 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448189]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   03:19:53
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448189/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448189/

    Command failed on smithi194 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests ObjectTest'

[4448212]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   09:53:05
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448212/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448212/

    saw valgrind issues

[4448213]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:58:14
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448213/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448213/

    Command failed (ragweed tests against rgw) on smithi199 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[4448211]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   02:11:40
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448211/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448211/

    Command failed on smithi155 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448224]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   01:33:46
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448224/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448224/

    Command failed on smithi146 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448207]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   07:51:48
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448207/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448207/

    saw valgrind issues

[4448219]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   07:57:44
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448219/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448219/

    saw valgrind issues

[4448223]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   02:21:03
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448223/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448223/

    Command failed on smithi204 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448215]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   02:06:40
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448215/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448215/

    Command failed on smithi123 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448227]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:58:39
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448227/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448227/

    Command failed (ragweed tests against rgw) on smithi134 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[4448195]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   01:53:15
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448195/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448195/

    Command failed on smithi058 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448194]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   02:16:02
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448194/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448194/

    Command failed on smithi063 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448203]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   01:38:25
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448203/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448203/

    Command failed on smithi125 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448196]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   02:04:11
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448196/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448196/

    Command failed on smithi092 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448205]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   07:52:17
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448205/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448205/

    saw valgrind issues

[4448222]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   02:51:42
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448222/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448222/

    Command failed on smithi080 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests ObjectTest'

[4448193]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   01:47:25
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448193/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448193/

    Command failed on smithi109 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448209]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   08:06:59
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448209/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448209/

    saw valgrind issues

[4448199]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   03:24:35
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448199/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448199/

    Command failed on smithi153 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests ObjectTest'

[4448198]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   02:46:22
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448198/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448198/

    Command failed on smithi002 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'

[4448228]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   01:30:45
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448228/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448228/

    Command failed on smithi006 with status 1: 'cd /home/ubuntu/cephtest/s3
    -tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks
    --no-build-cache --tests AWS4Test'



Dead
=================================================================
[4448226]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448226/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448226/

[4448200]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448200/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448200/

[4448206]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448206/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448206/

[4448183]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   10:53:45
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448183/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448183/

    psutil.NoSuchProcess process no longer exists (pid=24964)

[4448202]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   11:39:41
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448202/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448202/

    psutil.NoSuchProcess process no longer exists (pid=23640)

[4448191]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448191/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448191/

[4448190]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448190/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448190/

[4448218]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448218/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448218/

[4448192]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448192/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448192/

[4448208]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448208/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448208/

[4448188]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448188/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448188/

[4448220]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448220/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448220/

[4448210]  rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448210/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448210/

[4448204]  rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448204/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2019-10-26_18:13:03-rgw:verify-wip-yuval-add-kafka-notif-endpoint-distro-basic-smithi/4448204/
2019-10-27T09:40:47.266 INFO:teuthology.results:starting coverage generation