2021-02-06T14:17:06.013 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-06T14:17:06.015 INFO:teuthology.results:subset: '0/30000' 2021-02-06T14:17:06.015 INFO:teuthology.results:seed: '8016' 2021-02-06T14:37:36.748 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-06T14:37:36.776 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-02-06T15:51:38.409 INFO:teuthology.results:Tests finished! gathering results... 2021-02-06T15:51:42.093 INFO:scrape:Found 45 jobs 2021-02-06T15:51:45.070 INFO:scrape:Found 4 distinct failure reasons 2021-02-06T15:51:45.125 INFO:scrape:Failure: Command failed on smithi085 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2021-02-06T15:51:45.126 INFO:scrape:1 jobs: ['5856917'] 2021-02-06T15:51:45.126 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-02-06T15:51:45.127 INFO:scrape: 2021-02-06T15:51:45.127 INFO:scrape:Failure: Command failed on smithi031 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2021-02-06T15:51:45.128 INFO:scrape:1 jobs: ['5856930'] 2021-02-06T15:51:45.128 INFO:scrape:suites: ['frontend/civetweb', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/replicated', 'tasks/rgw_ragweed}'] 2021-02-06T15:51:45.129 INFO:scrape: 2021-02-06T15:51:45.129 INFO:scrape:Failure: Command failed on smithi100 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0' 2021-02-06T15:51:45.129 INFO:scrape:2 jobs: ['5856935', '5856912'] 2021-02-06T15:51:45.130 INFO:scrape:suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2021-02-06T15:51:45.130 INFO:scrape:suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2021-02-06T15:51:45.131 INFO:scrape: 2021-02-06T15:51:45.131 INFO:scrape:Failure: rgw multisite pubsub, test failures 2021-02-06T15:51:45.132 INFO:scrape:1 jobs: ['5856937'] 2021-02-06T15:51:45.132 INFO:scrape:suites: ['frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-02-06T15:51:45.132 INFO:scrape: 2021-02-06T15:51:45.135 INFO:teuthology.results:Sending results to aemerson@redhat.com: Test Run: aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 40 Fail ================================================================= [5856912] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:55:18 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856912/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856912/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92b037df0a8441a981a077ce971b98b7 Command failed on smithi061 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2' [5856917] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:19:53 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856917/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856917/ sentry: https://sentry.ceph.com/organizations/ceph/?query=73cb4fa34746438985f879b88eb5e0b1 Command failed on smithi085 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds'" [5856930] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:07:02 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856930/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856930/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd8489090a25415f854f0e2f8b09f65d Command failed on smithi031 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5856935] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:55:11 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856935/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856935/ sentry: https://sentry.ceph.com/organizations/ceph/?query=014bb2c9364047c19b021c35ae266977 Command failed on smithi100 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0' [5856937] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 01:12:28 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856937/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856937/ sentry: https://sentry.ceph.com/organizations/ceph/?query=550f69071c4749acb05da57186da59d8 rgw multisite pubsub, test failures Pass ================================================================= [5856911] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} time: 00:19:37 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856911/ [5856913] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} time: 00:09:23 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856913/ [5856914] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} time: 00:31:17 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856914/ [5856915] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:09:20 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856915/ [5856916] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} time: 00:27:05 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856916/ [5856918] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:45 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856918/ [5856919] rgw/tools/{centos_latest cluster tasks} time: 00:20:28 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856919/ [5856920] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:32:48 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856920/ [5856921] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:14:56 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856921/ [5856922] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:07 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856922/ [5856923] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_multipart_upload} time: 00:07:50 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856923/ [5856924] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:08:51 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856924/ [5856925] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} time: 00:26:31 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856925/ [5856926] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:12:15 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856926/ [5856927] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:22:46 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856927/ [5856928] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:18:27 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856928/ [5856929] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 00:32:08 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856929/ [5856931] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:09:13 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856931/ [5856932] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} time: 00:26:59 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856932/ [5856933] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:10:48 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856933/ [5856934] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:12:22 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856934/ [5856936] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} time: 00:12:41 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856936/ [5856938] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:12:27 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856938/ [5856939] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} time: 00:26:38 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856939/ [5856940] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:18:56 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856940/ [5856941] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:25 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856941/ [5856942] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:32:12 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856942/ [5856943] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:14:58 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856943/ [5856944] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:12:17 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856944/ [5856945] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_user_quota} time: 00:08:24 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856945/ [5856946] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_8}} time: 00:11:49 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856946/ [5856947] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} time: 00:26:45 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856947/ [5856948] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:12:17 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856948/ [5856949] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:22:54 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856949/ [5856950] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:17:18 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856950/ [5856951] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 00:32:56 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856951/ [5856952] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} time: 00:08:25 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856952/ [5856953] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} time: 00:12:35 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856953/ [5856954] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} time: 00:26:39 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856954/ [5856955] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:19 info: http://pulpito.ceph.com/aemerson-2021-02-05_03:01:23-rgw-wip-datalog-genbacking-distro-basic-smithi/5856955/