2022-03-21T13:46:53.869 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-21T13:46:53.870 INFO:teuthology.results:seed: '6268'
2022-03-21T15:08:49.255 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-21T15:08:49.290 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-03-21T16:51:56.599 INFO:teuthology.results:Tests finished! gathering results...
2022-03-21T16:51:58.328 INFO:scrape:Found 24 jobs
2022-03-21T16:52:00.252 INFO:scrape:Found 2 distinct failure reasons
2022-03-21T16:52:00.253 INFO:scrape:Failure: Command failed on smithi005 with status 1: 'cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest'
2022-03-21T16:52:00.253 INFO:scrape:1 jobs: ['6750047']
2022-03-21T16:52:00.254 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}']
2022-03-21T16:52:00.254 INFO:scrape:
2022-03-21T16:52:00.255 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi109 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"
2022-03-21T16:52:00.255 INFO:scrape:3 jobs: ['6750067', '6750056', '6750048']
2022-03-21T16:52:00.255 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'sharding$/{single}', 'tasks/{cls']
2022-03-21T16:52:00.256 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2022-03-21T16:52:00.257 INFO:scrape:
2022-03-21T16:52:00.259 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/
failed:  4
dead:    0
running: 0
waiting: 0
queued:  0
passed:  20


Fail
=================================================================
[6750047]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:22:36
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750047/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750047/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3ee36cfacb924fb787a7af43c6c6e664

    Command failed on smithi005 with status 1: 'cd
    /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean
    test --rerun-tasks --no-build-cache --tests ObjectTest'

[6750048]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:46:57
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750048/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750048/
sentry: https://sentry.ceph.com/organizations/ceph/?query=167b4abccc324131bcdb373392993374

    Command failed (s3 tests against rgw) on smithi006 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6750056]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:35:25
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750056/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750056/
sentry: https://sentry.ceph.com/organizations/ceph/?query=63edd34542ee4c7aa042e0d05f45ecb6

    Command failed (s3 tests against rgw) on smithi014 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

[6750067]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:28:18
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750067/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750067/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4a08eb06d92e46a4a37d8a83665d6255

    Command failed (s3 tests against rgw) on smithi109 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"



Pass
=================================================================
[6750045] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:43
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750045/

[6750046] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:41:41
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750046/

[6750049] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:47
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750049/

[6750050] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:41:39
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750050/

[6750051] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:17
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750051/

[6750052] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:37:13
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750052/

[6750053] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:04
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750053/

[6750054] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:35:29
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750054/

[6750055] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:52
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750055/

[6750057] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:32
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750057/

[6750058] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:49:27
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750058/

[6750059] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:10
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750059/

[6750060] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:45:40
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750060/

[6750061] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:42
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750061/

[6750062] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:46:16
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750062/

[6750063] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:29
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750063/

[6750064] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:39:49
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750064/

[6750065] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:27:21
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750065/

[6750066] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:39:02
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750066/

[6750068] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:34:26
info:   http://pulpito.ceph.com/gsalomon-2022-03-21_06:34:03-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6750068/