2023-02-04T14:28:51.424 INFO:root:teuthology version: 0.0.1.dev37+g00690ec
2023-02-04T14:28:51.426 INFO:teuthology.results:seed: '4241'
2023-02-04T14:37:05.204 INFO:root:teuthology version: 0.0.1.dev37+g00690ec
2023-02-04T14:37:05.206 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-02-04T15:06:07.346 INFO:teuthology.results:Tests finished! gathering results...
2023-02-04T15:06:07.640 INFO:scrape:Found 8 jobs
2023-02-04T15:06:08.141 INFO:scrape:Found 1 distinct failure reasons
2023-02-04T15:06:08.141 INFO:scrape:Failure: Command failed (ragweed tests against rgw) on smithi023 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"
2023-02-04T15:06:08.142 INFO:scrape:8 jobs: ['7145296', '7145300', '7145297', '7145298', '7145295', '7145294', '7145299', '7145293']
2023-02-04T15:06:08.142 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'tasks/{cls']
2023-02-04T15:06:08.143 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'inline-data$/{on}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2023-02-04T15:06:08.143 INFO:scrape:
2023-02-04T15:06:08.144 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/
failed:  8
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[7145293]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:46
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145293/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145293/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8db69948e82c48fdac5974c3918f4da3

    Command failed (ragweed tests against rgw) on smithi062 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[7145294]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:20:11
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145294/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145294/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0f20ad7b7af24f148231c458bb904fa3

    Command failed (ragweed tests against rgw) on smithi089 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[7145295]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:38
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145295/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145295/
sentry: https://sentry.ceph.com/organizations/ceph/?query=63f3bdc146254f67bbdc9bf7552310d6

    Command failed (ragweed tests against rgw) on smithi052 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[7145296]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:20:41
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145296/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145296/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fd4f1b70ba944782a9b4fae377d95f84

    Command failed (ragweed tests against rgw) on smithi023 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[7145297]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:38
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145297/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145297/
sentry: https://sentry.ceph.com/organizations/ceph/?query=95be9f10c21546d5b6ccc29fdf5644e4

    Command failed (ragweed tests against rgw) on smithi088 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[7145298]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:20:07
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145298/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145298/
sentry: https://sentry.ceph.com/organizations/ceph/?query=81ec2fa76e29440badafd2b3c3104e5d

    Command failed (ragweed tests against rgw) on smithi172 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[7145299]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:23
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145299/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145299/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f5def2fe4366465ea6e00b9c01909eff

    Command failed (ragweed tests against rgw) on smithi111 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

[7145300]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:20:16
info:   http://pulpito.ceph.com/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145300/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-01-31_15:59:57-rgw:verify-json_rgw_integration-distro-default-smithi/7145300/
sentry: https://sentry.ceph.com/organizations/ceph/?query=70915b9612894237ad8cd6d16b7be828

    Command failed (ragweed tests against rgw) on smithi008 with status 1:
    "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf
    RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"