2021-05-19T17:19:37.629 INFO:root:teuthology version: 1.1.0-471a2f1e 2021-05-19T17:19:37.630 INFO:teuthology.results:subset: '1/10' 2021-05-19T17:19:37.630 INFO:teuthology.results:seed: '8371' 2021-05-19T17:33:44.751 INFO:root:teuthology version: 1.1.0-471a2f1e 2021-05-19T17:33:44.755 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-05-19T20:15:55.898 INFO:teuthology.results:Tests finished! gathering results... 2021-05-19T20:15:59.581 INFO:scrape:Found 38 jobs 2021-05-19T20:16:00.585 INFO:scrape:Found 4 distinct failure reasons 2021-05-19T20:16:00.587 INFO:scrape:Failure: Command failed on smithi161 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2021-05-19T20:16:00.588 INFO:scrape:1 jobs: ['6120624'] 2021-05-19T20:16:00.588 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-05-19T20:16:00.589 INFO:scrape: 2021-05-19T20:16:00.590 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi008 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" 2021-05-19T20:16:00.591 INFO:scrape:1 jobs: ['6120647'] 2021-05-19T20:16:00.592 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/vault_old', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 'supported-random-distro$/{rhel_8}}'] 2021-05-19T20:16:00.592 INFO:scrape: 2021-05-19T20:16:00.593 INFO:scrape:Failure: too many values to unpack (expected 1) 2021-05-19T20:16:00.594 INFO:scrape:3 jobs: ['6120628', '6120649', '6120633'] 2021-05-19T20:16:00.595 INFO:scrape:suites intersection: ['frontend/beast', 'overrides', 'rgw/singleton/{all/rgw_cephadm'] 2021-05-19T20:16:00.595 INFO:scrape:suites union: ['frontend/beast', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/rgw_cephadm', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}'] 2021-05-19T20:16:00.596 INFO:scrape: 2021-05-19T20:16:00.597 INFO:scrape:Failure: Command failed on smithi123 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2021-05-19T20:16:00.597 INFO:scrape:1 jobs: ['6120622'] 2021-05-19T20:16:00.598 INFO:scrape:suites: ['bluestore-bitmap', 'fixed-2', 'overrides', 'rgw/notifications/{beast', 'supported-random-distro$/{rhel_8}', 'tasks/{0-install', 'test_kafka}}'] 2021-05-19T20:16:00.598 INFO:scrape: 2021-05-19T20:16:00.600 INFO:teuthology.results:Sending results to to.my.trociny@gmail.com: Test Run: trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 32 Fail ================================================================= [6120622] rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-random-distro$/{rhel_8} tasks/{0-install test_kafka}} ----------------------------------------------------------------- time: 00:41:34 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120622/ log: http://qa-proxy.ceph.com/teuthology/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120622/ Command failed on smithi123 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' [6120624] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:20:28 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120624/ log: http://qa-proxy.ceph.com/teuthology/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120624/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48da94099044493480c451fb6d2da618 Command failed on smithi161 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds'" [6120628] rgw/singleton/{all/rgw_cephadm frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120628/ log: http://qa-proxy.ceph.com/teuthology/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120628/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd096ef54a8a45e7b7f12a19d4bcdecf too many values to unpack (expected 1) [6120633] rgw/singleton/{all/rgw_cephadm frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120633/ log: http://qa-proxy.ceph.com/teuthology/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120633/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0cfeeab2b712401cadc67473e9de013a too many values to unpack (expected 1) [6120647] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:22:41 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120647/ log: http://qa-proxy.ceph.com/teuthology/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120647/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e56b51c40dfb4fd09e0413ecfb68fbeb Command failed (s3 tests against rgw) on smithi008 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6120649] rgw/singleton/{all/rgw_cephadm frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120649/ log: http://qa-proxy.ceph.com/teuthology/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120649/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e30d63b862cb4c0dacb2ecfe55a4dde5 too many values to unpack (expected 1) Pass ================================================================= [6120617] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:12:07 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120617/ [6120618] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} time: 00:18:30 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120618/ [6120619] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:15:50 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120619/ [6120620] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest} time: 00:09:04 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120620/ [6120621] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{ubuntu_latest} tasks/test_multi} time: 00:29:12 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120621/ [6120623] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{rhel_8} tasks/{0-install ststests webidentity}} time: 00:37:01 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120623/ [6120625] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:13:35 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120625/ [6120626] rgw/tools/{centos_latest cluster tasks} time: 02:48:28 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120626/ [6120627] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:39 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120627/ [6120629] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:18:17 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120629/ [6120630] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:10:43 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120630/ [6120631] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} time: 00:11:25 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120631/ [6120632] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest} time: 00:08:10 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120632/ [6120634] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} time: 00:18:41 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120634/ [6120635] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:28:49 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120635/ [6120636] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} time: 00:12:10 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120636/ [6120637] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest} time: 00:12:15 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120637/ [6120638] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:11:36 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120638/ [6120639] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}} time: 00:10:55 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120639/ [6120640] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:06:09 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120640/ [6120641] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} time: 00:11:04 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120641/ [6120642] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:14:17 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120642/ [6120643] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest} time: 00:07:48 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120643/ [6120644] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} time: 00:21:09 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120644/ [6120645] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:11:52 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120645/ [6120646] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:12:39 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120646/ [6120648] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest} time: 00:08:59 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120648/ [6120650] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:26:41 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120650/ [6120651] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} time: 00:15:15 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120651/ [6120652] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} time: 00:10:57 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120652/ [6120653] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest} time: 00:08:03 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120653/ [6120654] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:20:40 info: http://pulpito.ceph.com/trociny-2021-05-18_16:55:27-rgw-wip-mgolub-testing-distro-basic-smithi/6120654/