2022-03-21T03:43:34.221 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-21T03:43:34.222 INFO:teuthology.results:seed: '759'
2022-03-21T04:05:00.217 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-21T04:05:00.223 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-03-21T06:29:10.603 INFO:teuthology.results:Tests finished! gathering results...
2022-03-21T06:29:12.434 INFO:scrape:Found 24 jobs
2022-03-21T06:29:13.658 INFO:scrape:Found 2 distinct failure reasons
2022-03-21T06:29:13.659 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi049 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"
2022-03-21T06:29:13.660 INFO:scrape:5 jobs: ['6749544', '6749563', '6749543', '6749554', '6749541']
2022-03-21T06:29:13.660 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls']
2022-03-21T06:29:13.661 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2022-03-21T06:29:13.661 INFO:scrape:
2022-03-21T06:29:13.662 INFO:scrape:Failure: Command failed on smithi064 with status 1: 'cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest'
2022-03-21T06:29:13.662 INFO:scrape:1 jobs: ['6749560']
2022-03-21T06:29:13.663 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/lockdep}']
2022-03-21T06:29:13.663 INFO:scrape:
2022-03-21T06:29:13.665 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  18


Fail
=================================================================
[6749541]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:40:40
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749541/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749541/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1fbe60ffd03e406fad57a3a56531ca91

    Command failed (s3 tests against rgw) on smithi110 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6749543]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   02:34:30
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749543/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749543/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b1d1190a53aa40e3b49c823f7cbc60a6

    Command failed (s3 tests against rgw) on smithi052 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6749544]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:29:54
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749544/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749544/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d2d816bb5de5498b83d7dc9cf78cc25e

    Command failed (s3 tests against rgw) on smithi049 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6749554]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:27:30
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749554/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749554/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7c28c284ecce4172a12165d99a0558ae

    Command failed (s3 tests against rgw) on smithi082 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6749560]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:22:44
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749560/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749560/
sentry: https://sentry.ceph.com/organizations/ceph/?query=acc1b1b0e5cd4ef59c54594f9bcb4820

    Command failed on smithi064 with status 1: 'cd
    /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean
    test --rerun-tasks --no-build-cache --tests ObjectTest'

[6749563]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:41:35
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749563/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749563/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bfbf623ee2bb4286adebe76014f132ff

    Command failed (s3 tests against rgw) on smithi045 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"



Pass
=================================================================
[6749540] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:45
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749540/

[6749542] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:00
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749542/

[6749545] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:46:26
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749545/

[6749546] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:50
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749546/

[6749547] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:38:16
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749547/

[6749548] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:46
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749548/

[6749549] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:41:23
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749549/

[6749550] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:07
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749550/

[6749551] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:34:23
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749551/

[6749552] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:44
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749552/

[6749553] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:52:18
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749553/

[6749555] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:49:58
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749555/

[6749556] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:27:51
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749556/

[6749557] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:53:54
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749557/

[6749558] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:21
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749558/

[6749559] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:37:47
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749559/

[6749561] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:40:36
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749561/

[6749562] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:55
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_02:36:52-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6749562/