2022-03-22T13:31:21.263 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-22T13:31:21.266 INFO:teuthology.results:seed: '8960' 2022-03-22T13:48:43.504 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-22T13:48:43.550 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-22T16:16:54.785 INFO:teuthology.results:Tests finished! gathering results... 2022-03-22T16:16:56.097 INFO:scrape:Found 12 jobs 2022-03-22T16:16:58.132 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752705/teuthology.log matches 2022-03-22T16:16:58.133 WARNING:scrape:Misunderstood line: 2022-03-22T16:16:58.133 INFO:scrape:Found 3 distinct failure reasons 2022-03-22T16:16:58.134 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds 2022-03-22T16:16:58.134 INFO:scrape:1 jobs: ['6752708'] 2022-03-22T16:16:58.135 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}'] 2022-03-22T16:16:58.135 INFO:scrape: 2022-03-22T16:16:58.135 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi061 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" 2022-03-22T16:16:58.136 INFO:scrape:1 jobs: ['6752703'] 2022-03-22T16:16:58.136 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/valgrind}'] 2022-03-22T16:16:58.137 INFO:scrape: 2022-03-22T16:16:58.137 INFO:scrape:Valgrind: 2022-03-22T16:16:58.138 INFO:scrape:1 jobs: ['6752705'] 2022-03-22T16:16:58.138 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/valgrind}'] 2022-03-22T16:16:58.139 INFO:scrape: 2022-03-22T16:16:58.140 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 9 Fail ================================================================= [6752703] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 02:29:19 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752703/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752703/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a513331e289548bd9f9191e5b1d90abc Command failed (s3 tests against rgw) on smithi061 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6752705] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:35:47 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752705/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752705/ saw valgrind issues [6752708] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:18:46 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752708/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752708/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9cd004b858db4f3d9827328d11ccfde2 reached maximum tries (90) after waiting for 540 seconds Pass ================================================================= [6752698] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:06 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752698/ [6752699] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:48:27 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752699/ [6752700] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:29:39 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752700/ [6752701] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:51:02 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752701/ [6752702] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:29:20 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752702/ [6752704] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:33 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752704/ [6752706] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:30 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752706/ [6752707] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:35:49 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752707/ [6752709] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:33:58 info: http://pulpito.ceph.com/gsalomon-2022-03-22_13:29:50-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6752709/