2021-10-20T10:06:54.868 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-20T10:06:54.869 INFO:teuthology.results:seed: '4648' 2021-10-20T10:30:41.270 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-20T10:30:41.318 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-20T12:16:49.000 INFO:teuthology.results:Tests finished! gathering results... 2021-10-20T12:16:52.087 INFO:scrape:Found 48 jobs 2021-10-20T12:16:52.451 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451963/teuthology.log matches 2021-10-20T12:16:52.452 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:52.629 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451995/teuthology.log matches 2021-10-20T12:16:52.630 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:53.046 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451965/teuthology.log matches 2021-10-20T12:16:53.047 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:53.302 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452003/teuthology.log matches 2021-10-20T12:16:53.303 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:53.530 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451959/teuthology.log matches 2021-10-20T12:16:53.531 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:53.768 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452001/teuthology.log matches 2021-10-20T12:16:53.769 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:53.924 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451997/teuthology.log matches 2021-10-20T12:16:53.925 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:54.141 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451981/teuthology.log matches 2021-10-20T12:16:54.142 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:54.322 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451983/teuthology.log matches 2021-10-20T12:16:54.323 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:54.625 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451975/teuthology.log matches 2021-10-20T12:16:54.626 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:54.854 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452005/teuthology.log matches 2021-10-20T12:16:54.855 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:55.052 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451985/teuthology.log matches 2021-10-20T12:16:55.053 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:55.314 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451977/teuthology.log matches 2021-10-20T12:16:55.315 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:55.538 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451989/teuthology.log matches 2021-10-20T12:16:55.539 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:55.760 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451973/teuthology.log matches 2021-10-20T12:16:55.761 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:55.989 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451971/teuthology.log matches 2021-10-20T12:16:55.990 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:56.179 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451987/teuthology.log matches 2021-10-20T12:16:56.180 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:56.447 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451993/teuthology.log matches 2021-10-20T12:16:56.448 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:56.751 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451967/teuthology.log matches 2021-10-20T12:16:56.752 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:57.368 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451961/teuthology.log matches 2021-10-20T12:16:57.369 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:57.587 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451991/teuthology.log matches 2021-10-20T12:16:57.588 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:57.879 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451969/teuthology.log matches 2021-10-20T12:16:57.880 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:58.187 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451979/teuthology.log matches 2021-10-20T12:16:58.188 WARNING:scrape:Misunderstood line: 2021-10-20T12:16:58.189 INFO:scrape:Found 1 distinct failure reasons 2021-10-20T12:16:58.189 INFO:scrape:Valgrind: 2021-10-20T12:16:58.190 INFO:scrape:26 jobs: ['6451963', '6451995', '6451996', '6451965', '6452003', '6451959', '6452001', '6451997', '6451981', '6451983', '6451975', '6452005', '6451985', '6451977', '6451989', '6451973', '6451971', '6451987', '6451993', '6451999', '6451967', '6451961', '6451991', '6451969', '6451966', '6451979'] 2021-10-20T12:16:58.190 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls'] 2021-10-20T12:16:58.191 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] 2021-10-20T12:16:58.191 INFO:scrape: 2021-10-20T12:16:58.194 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/ failed: 26 dead: 0 running: 0 waiting: 0 queued: 0 passed: 22 Fail ================================================================= [6451959] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:45:59 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451959/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451959/ saw valgrind issues [6451961] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:41:55 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451961/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451961/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92ebae60f6944530b81f00f9d80e8d05 Command failed (s3 tests against rgw) on smithi086 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6451963] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:38:14 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451963/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451963/ saw valgrind issues [6451965] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:29:31 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451965/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451965/ saw valgrind issues [6451966] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:19:49 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451966/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451966/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4395e23c4d7546f4bfbde31f6f0bbfde reached maximum tries (90) after waiting for 540 seconds [6451967] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:24:49 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451967/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451967/ saw valgrind issues [6451969] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:41:25 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451969/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451969/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39ef2d7ba24542ca9d3bf457c7254577 Command failed (s3 tests against rgw) on smithi050 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6451971] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:47:11 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451971/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451971/ saw valgrind issues [6451973] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:46:36 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451973/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451973/ saw valgrind issues [6451975] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:39:47 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451975/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451975/ saw valgrind issues [6451977] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:30:15 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451977/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451977/ saw valgrind issues [6451979] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:29:44 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451979/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451979/ saw valgrind issues [6451981] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:26:54 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451981/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451981/ saw valgrind issues [6451983] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:44:50 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451983/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451983/ saw valgrind issues [6451985] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:43:25 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451985/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451985/ "2021-10-20T10:42:58.793379+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6451987] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:40:22 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451987/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451987/ saw valgrind issues [6451989] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:32:39 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451989/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451989/ saw valgrind issues [6451991] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:32:26 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451991/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451991/ saw valgrind issues [6451993] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:24:37 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451993/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451993/ saw valgrind issues [6451995] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:38:32 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451995/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451995/ saw valgrind issues [6451996] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:30:09 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451996/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451996/ "2021-10-20T10:41:59.644217+0000 mon.a (mon.0) 134 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log [6451997] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:41:42 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451997/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451997/ saw valgrind issues [6451999] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:20:36 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451999/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451999/ sentry: https://sentry.ceph.com/organizations/ceph/?query=118b78d783a945d1844d103a7a137f8b reached maximum tries (90) after waiting for 540 seconds [6452001] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:31:32 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452001/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452001/ saw valgrind issues [6452003] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:25:56 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452003/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452003/ saw valgrind issues [6452005] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:25:04 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452005/ log: http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452005/ saw valgrind issues Pass ================================================================= [6451958] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:39 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451958/ [6451960] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:09 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451960/ [6451962] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:38 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451962/ [6451964] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:45 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451964/ [6451968] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:42 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451968/ [6451970] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:55 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451970/ [6451972] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:28:03 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451972/ [6451974] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:29:30 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451974/ [6451976] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:21 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451976/ [6451978] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:18 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451978/ [6451980] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:45 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451980/ [6451982] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:49 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451982/ [6451984] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:33:14 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451984/ [6451986] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:38 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451986/ [6451988] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:32:18 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451988/ [6451990] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:59 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451990/ [6451992] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:32:02 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451992/ [6451994] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:18 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451994/ [6451998] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:02 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6451998/ [6452000] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:32:08 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452000/ [6452002] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:30:34 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452002/ [6452004] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:24 info: http://pulpito.ceph.com/gsalomon-2021-10-20_10:06:35-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6452004/