2021-09-14T22:03:25.775 INFO:root:teuthology version: 1.1.0-b135a4f8
2021-09-14T22:03:25.776 INFO:teuthology.results:subset: '1/3'
2021-09-14T22:03:25.776 INFO:teuthology.results:seed: '831'
2021-09-15T01:13:36.300 INFO:root:teuthology version: 1.1.0-b135a4f8
2021-09-15T01:13:36.334 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-09-15T02:47:42.890 INFO:teuthology.results:Tests finished! gathering results...
2021-09-15T02:47:43.658 INFO:scrape:Found 16 jobs
2021-09-15T02:47:47.660 INFO:scrape:Found 2 distinct failure reasons
2021-09-15T02:47:47.661 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi157 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"
2021-09-15T02:47:47.661 INFO:scrape:15 jobs: ['6390158', '6390160', '6390170', '6390162', '6390173', '6390171', '6390168', '6390161', '6390166', '6390163', '6390164', '6390167', '6390165', '6390159', '6390172']
2021-09-15T02:47:47.662 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls']
2021-09-15T02:47:47.662 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2021-09-15T02:47:47.663 INFO:scrape:
2021-09-15T02:47:47.663 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2021-09-15T02:47:47.664 INFO:scrape:1 jobs: ['6390169']
2021-09-15T02:47:47.664 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/valgrind}']
2021-09-15T02:47:47.665 INFO:scrape:
2021-09-15T02:47:47.666 INFO:teuthology.results:Sending results to ivancich@redhat.com: Test Run: ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/
failed:  16
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6390158]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:26:27
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390158/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390158/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e71094aeb9046b0841ae8b9c327f3e4

    Command failed (s3 tests against rgw) on smithi157 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390159]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:32:10
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390159/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390159/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa839a5bf90849c7a0cf68723cc09f7c

    Command failed (s3 tests against rgw) on smithi157 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390160]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:27:36
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390160/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390160/
sentry: https://sentry.ceph.com/organizations/ceph/?query=048d1319809d4819a8b5d133655cdb8e

    Command failed (s3 tests against rgw) on smithi099 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390161]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:20:13
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390161/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390161/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c032c9fc29241f48de4fa98c93516c8

    Command failed (s3 tests against rgw) on smithi027 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390162]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:27:47
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390162/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390162/
sentry: https://sentry.ceph.com/organizations/ceph/?query=395c946405814eeab7d17ba5d2467ff4

    Command failed (s3 tests against rgw) on smithi077 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390163]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:21:47
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390163/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390163/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7cc25a39c0e84fcd867445494a827640

    Command failed (s3 tests against rgw) on smithi031 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390164]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:27:40
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390164/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390164/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5e6a72a98e74442930167bc7bed8d93

    Command failed (s3 tests against rgw) on smithi060 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390165]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:17:15
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390165/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390165/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f487da6b5d44921a1f83865ebccff04

    Command failed (s3 tests against rgw) on smithi078 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390166]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:28:10
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390166/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390166/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f5932263e3ab4257aab419c563c3f1f7

    Command failed (s3 tests against rgw) on smithi117 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390167]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:25:24
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390167/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390167/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6ca5c49d7fdb45a28a26ad4138189113

    Command failed (s3 tests against rgw) on smithi085 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390168]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:26:28
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390168/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390168/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7598e588c5c443a2ab87c821bca899c0

    Command failed (s3 tests against rgw) on smithi150 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390169]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:19:28
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390169/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390169/
sentry: https://sentry.ceph.com/organizations/ceph/?query=43494c4a1367461ba344a72483201127

    reached maximum tries (90) after waiting for 540 seconds

[6390170]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:28:17
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390170/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390170/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c2cc8f9c8b2147e18d9722f148bbd375

    Command failed (s3 tests against rgw) on smithi110 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390171]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:28:07
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390171/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390171/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cfbfae3589b64abd8c3ad0e4a1d5f515

    Command failed (s3 tests against rgw) on smithi186 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390172]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:30:22
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390172/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390172/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce8b7d5f8fb74cab82163971ed33da25

    Command failed (s3 tests against rgw) on smithi103 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6390173]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:15:08
info:   http://pulpito.ceph.com/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390173/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-14_21:14:53-rgw-wip-fix-bi-test-error-MORE-LOGGING-distro-basic-smithi/6390173/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c131b4ec14dd461eadefa5bd27f1a88f

    Command failed (s3 tests against rgw) on smithi090 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"