2021-08-09T22:20:55.528 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-09T22:20:55.531 INFO:teuthology.results:subset: '1/3' 2021-08-09T22:20:55.531 INFO:teuthology.results:seed: '6004' 2021-08-10T03:19:53.965 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-10T03:19:54.001 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-08-10T04:55:01.052 INFO:teuthology.results:Tests finished! gathering results... 2021-08-10T04:55:07.117 INFO:scrape:Found 55 jobs 2021-08-10T04:55:07.506 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330153/teuthology.log matches 2021-08-10T04:55:07.507 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:07.885 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330122/teuthology.log matches 2021-08-10T04:55:07.886 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:09.863 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330111/teuthology.log matches 2021-08-10T04:55:09.864 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:10.146 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330142/teuthology.log matches 2021-08-10T04:55:10.147 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:10.426 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330147/teuthology.log matches 2021-08-10T04:55:10.427 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:11.018 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330128/teuthology.log matches 2021-08-10T04:55:11.019 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:11.311 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330117/teuthology.log matches 2021-08-10T04:55:11.312 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:12.458 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330136/teuthology.log matches 2021-08-10T04:55:12.460 WARNING:scrape:Misunderstood line: 2021-08-10T04:55:14.173 INFO:scrape:Found 1 distinct failure reasons 2021-08-10T04:55:14.174 INFO:scrape:Valgrind: 2021-08-10T04:55:14.175 INFO:scrape:24 jobs: ['6330153', '6330122', '6330106', '6330114', '6330099', '6330129', '6330103', '6330111', '6330142', '6330147', '6330149', '6330140', '6330128', '6330117', '6330126', '6330102', '6330120', '6330136', '6330132', '6330110', '6330115', '6330151', '6330100', '6330130'] 2021-08-10T04:55:14.176 INFO:scrape:suites intersection: [] 2021-08-10T04:55:14.177 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '2-kms/kmip', '2-kms/vault_kv', '2-kms/vault_old', '3-rgw/rgw', '4-tests/{s3tests}', 'bluestore-bitmap', 'centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'fixed-2', 'frontend/beast', 'hadoop/default', 'hadoop/v32', 'http', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'omap_limits', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'reshard', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/hadoop-s3a/{clusters/fixed-2', 'rgw/multisite/{clusters', 'rgw/notifications/{beast', 'rgw/singleton/{all/radosgw-admin', 'rgw/tempest/{clusters/fixed-1', 'rgw/verify/{0-install', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3a-hadoop}', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'supported-all-distro$/{centos_8}', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{centos_8.stream}}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rgw_tempest', 'tasks/s3tests-website', 'tasks/test_multi}', 'tasks/{0-install', 'tasks/{cls', 'test_amqp', 'test_kafka', 'test_others}}', 'ubuntu_latest}', 'validater/lockdep}', 'validater/valgrind}'] 2021-08-10T04:55:14.178 INFO:scrape: 2021-08-10T04:55:14.180 INFO:teuthology.results:Sending results to yehuda@redhat.com: Test Run: yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/ failed: 24 dead: 0 running: 0 waiting: 0 queued: 0 passed: 31 Fail ================================================================= [6330099] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:25:43 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330099/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330099/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a179b369e1f046ee9166ed77536f347a Command failed on smithi146 with status 1: 'cd /home/ubuntu/cephtest/barbican && . .barbicanenv/bin/activate && pip install pytz -e /home/ubuntu/cephtest/barbican' [6330100] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:12:02 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330100/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc1033c1475a4397b8392fec7cf0fd49 Command failed on smithi002 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2' [6330102] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{ubuntu_latest} tasks/test_multi} ----------------------------------------------------------------- time: 00:52:02 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330102/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330102/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11fc5955c15449c483361e50a251a4fc rgw multisite test failures [6330103] rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}} ----------------------------------------------------------------- time: 00:35:28 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330103/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330103/ Command failed on smithi005 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' [6330106] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:21:37 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330106/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330106/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2f03ed5bd0084d349020090d71340c5c Command failed on smithi131 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds|.*test_object_services.ObjectTest.test_create_object_wit h_transfer_encoding'" [6330110] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} ----------------------------------------------------------------- time: 00:16:39 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330110/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330110/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb0f7c6fc5db4e04b48f02a130148adf Command failed (s3 tests against rgw) on smithi149 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330111] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:40:35 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330111/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330111/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b95b5c57f1eb4a1fb2d3b844e213ddfb Command failed (s3 tests against rgw) on smithi080 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330114] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:23:34 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330114/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330114/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24a755b471eb416ab9de0b8fb5870cd5 Command failed (s3 tests against rgw) on smithi104 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330115] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:10 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330115/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330115/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab3c635948054313b88a3dd014d592ce Command failed on smithi036 with status 1: 'cd /home/ubuntu/cephtest/pykmip && . .pykmipenv/bin/activate && pip install pytz -e /home/ubuntu/cephtest/pykmip' [6330117] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:25:51 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330117/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330117/ saw valgrind issues [6330120] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:24:33 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330120/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330120/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24588f4b4f9d4912bd098f906e9a45b6 Command failed (s3 tests against rgw) on smithi106 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330122] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:23:46 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330122/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330122/ saw valgrind issues [6330126] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:24:57 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330126/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330126/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a2cb1b5634c4aacb0d7b72dfda023c4 Command failed (s3 tests against rgw) on smithi017 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330128] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:29:25 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330128/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330128/ saw valgrind issues [6330129] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:15:42 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330129/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6097c07f7f234434af5e2be8df1f15ea Command failed (s3 tests against rgw) on smithi137 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330130] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:12:31 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330130/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330130/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efbaef6e37874ed483a2b5ff47322efd Command failed on smithi061 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0' [6330132] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_8.stream} tasks/test_multi} ----------------------------------------------------------------- time: 02:00:06 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330132/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330132/ sentry: https://sentry.ceph.com/organizations/ceph/?query=225b393377e54c6bb4fd22118c14883b rgw multisite test failures [6330136] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:39:30 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330136/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330136/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b30fd4ceb8b6408282727d316b8ed9d3 Command failed (s3 tests against rgw) on smithi028 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330140] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:14:30 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330140/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d23be72293ba4ee8a34f8874ff4ed7bc Command failed (s3 tests against rgw) on smithi196 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330142] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:41:06 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330142/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330142/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5a03992f34b43ecbe4ec5a2d7236993 Command failed (s3 tests against rgw) on smithi019 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330147] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:39:36 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330147/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330147/ sentry: https://sentry.ceph.com/organizations/ceph/?query=146b708371f245bfba6832bafedc9bd7 Command failed (s3 tests against rgw) on smithi146 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330149] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8.stream}} ----------------------------------------------------------------- time: 00:12:09 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330149/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330149/ "2021-08-10T03:38:55.663162+0000 mon.a (mon.0) 238 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [6330151] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:25:46 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330151/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330151/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84184c86ccc547f2a390ca585893e7db Command failed (s3 tests against rgw) on smithi158 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6330153] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:24:44 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330153/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330153/ saw valgrind issues Pass ================================================================= [6330101] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest} time: 00:09:33 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330101/ [6330104] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:20:11 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330104/ [6330105] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{rhel_8} tasks/{0-install ststests webidentity}} time: 00:35:42 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330105/ [6330107] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:13:39 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330107/ [6330108] rgw/tools/{centos_latest cluster tasks} time: 02:44:38 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330108/ [6330109] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:28:59 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330109/ [6330112] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest} time: 00:08:35 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330112/ [6330113] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:12:10 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330113/ [6330116] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}} time: 00:14:01 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330116/ [6330118] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_ragweed ubuntu_latest} time: 00:08:46 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330118/ [6330119] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} time: 00:16:14 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330119/ [6330121] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_s3tests ubuntu_latest} time: 00:12:28 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330121/ [6330123] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} time: 00:21:16 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330123/ [6330124] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8.stream}} time: 00:12:04 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330124/ [6330125] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:12:08 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330125/ [6330127] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_user_quota ubuntu_latest} time: 00:08:54 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330127/ [6330131] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota ubuntu_latest} time: 00:09:31 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330131/ [6330133] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:19:21 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330133/ [6330134] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:13:16 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330134/ [6330135] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:44 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330135/ [6330137] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_multipart_upload ubuntu_latest} time: 00:08:58 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330137/ [6330138] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:12:05 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330138/ [6330139] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:29:48 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330139/ [6330141] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_8}} time: 00:12:43 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330141/ [6330143] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_ragweed ubuntu_latest} time: 00:08:28 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330143/ [6330144] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} time: 00:16:18 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330144/ [6330145] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:29:32 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330145/ [6330146] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_s3tests ubuntu_latest} time: 00:13:00 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330146/ [6330148] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} time: 00:11:52 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330148/ [6330150] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:12:39 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330150/ [6330152] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_user_quota ubuntu_latest} time: 00:08:37 info: http://pulpito.ceph.com/yehuda-2021-08-09_15:19:45-rgw-wip-rgw-realm-resolve-distro-basic-smithi/6330152/