2021-03-11T08:08:29.771 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-11T08:08:29.775 INFO:teuthology.results:seed: '3744' 2021-03-11T08:20:28.036 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-11T08:20:28.080 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-03-11T09:15:32.187 INFO:teuthology.results:Tests finished! gathering results... 2021-03-11T09:15:33.274 INFO:scrape:Found 8 jobs 2021-03-11T09:15:33.636 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956025/teuthology.log matches 2021-03-11T09:15:33.637 WARNING:scrape:Misunderstood line: 2021-03-11T09:15:34.114 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956023/teuthology.log matches 2021-03-11T09:15:34.116 WARNING:scrape:Misunderstood line: 2021-03-11T09:15:34.621 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956021/teuthology.log matches 2021-03-11T09:15:34.622 WARNING:scrape:Misunderstood line: 2021-03-11T09:15:34.623 INFO:scrape:Found 1 distinct failure reasons 2021-03-11T09:15:34.623 INFO:scrape:Valgrind: 2021-03-11T09:15:34.624 INFO:scrape:5 jobs: ['5956025', '5956024', '5956023', '5956027', '5956021'] 2021-03-11T09:15:34.624 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls'] 2021-03-11T09:15:34.625 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] 2021-03-11T09:15:34.625 INFO:scrape: 2021-03-11T09:15:34.627 INFO:teuthology.results:Sending results to mkogan@redhat.com: Test Run: mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [5956021] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:48:15 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956021/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956021/ sentry: https://sentry.ceph.com/organizations/ceph/?query=968dfb31fe904f4085d1382879159043 Command failed (s3 tests against rgw) on smithi159 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [5956023] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:48:34 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956023/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956023/ saw valgrind issues [5956024] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:47:26 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956024/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956024/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd0fccff4dbd4dbd9ee18a619900c1dc Command failed on smithi043 with status 1: 'cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest' [5956025] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:47:55 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956025/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956025/ saw valgrind issues [5956027] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:22:24 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956027/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956027/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a1b797d5eac434795e1779eb6911bd8 Command failed (ragweed tests against rgw) on smithi084 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'" Pass ================================================================= [5956020] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:28 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956020/ [5956022] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:49 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956022/ [5956026] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:37:55 info: http://pulpito.ceph.com/mkogan-2021-03-11_08:07:41-rgw:verify-wip-rgw-d3n-cache-upstreaming_i62-distro-basic-smithi/5956026/