2021-05-21T21:18:16.298 INFO:root:teuthology version: 1.1.0-471a2f1e 2021-05-21T21:18:16.300 INFO:teuthology.results:subset: '111/120000' 2021-05-21T21:18:16.300 INFO:teuthology.results:seed: '5030' 2021-05-21T21:50:11.217 INFO:root:teuthology version: 1.1.0-471a2f1e 2021-05-21T21:50:11.251 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-05-21T22:34:14.540 INFO:teuthology.results:Tests finished! gathering results... 2021-05-21T22:34:18.410 INFO:scrape:Found 39 jobs 2021-05-21T22:34:18.935 WARNING:scrape:Not-understood crash indication 2021-05-21T21:57:13.847 INFO:tasks.rgw.c2.client.0.smithi041.stderr:daemon-helper: command crashed with signal 11 2021-05-21T22:34:18.936 WARNING:scrape:Not-understood crash indication 2021-05-21T21:57:13.884 INFO:tasks.rgw.c1.client.1.smithi006.stderr:daemon-helper: command crashed with signal 11 2021-05-21T22:34:18.936 WARNING:scrape:Not-understood crash indication 2021-05-21T22:34:19.567 WARNING:scrape:Not-understood crash indication 2021-05-21T22:16:08.228 INFO:tasks.rgw.c1.client.1.smithi029.stderr:daemon-helper: command crashed with signal 11 2021-05-21T22:34:19.568 WARNING:scrape:Not-understood crash indication 2021-05-21T22:16:08.230 INFO:tasks.rgw.c2.client.0.smithi083.stderr:daemon-helper: command crashed with signal 11 2021-05-21T22:34:19.568 WARNING:scrape:Not-understood crash indication 2021-05-21T22:34:19.923 INFO:scrape:Found 3 distinct failure reasons 2021-05-21T22:34:19.924 INFO:scrape:Failure: rgw multisite, test failures 2021-05-21T22:34:19.924 INFO:scrape:4 jobs: ['6127891', '6127880', '6127900', '6127910'] 2021-05-21T22:34:19.925 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-05-21T22:34:19.925 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-05-21T22:34:19.925 INFO:scrape: 2021-05-21T22:34:19.926 INFO:scrape:Failure: Command failed on smithi200 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2021-05-21T22:34:19.926 INFO:scrape:1 jobs: ['6127882'] 2021-05-21T22:34:19.927 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-05-21T22:34:19.927 INFO:scrape: 2021-05-21T22:34:19.928 INFO:scrape:Failure: Cannot create secret 2021-05-21T22:34:19.928 INFO:scrape:1 jobs: ['6127877'] 2021-05-21T22:34:19.928 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2021-05-21T22:34:19.929 INFO:scrape: 2021-05-21T22:34:19.931 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 33 Fail ================================================================= [6127877] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127877/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127877/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df68e4e367ae496db9d3ceb5f28ea698 Cannot create secret [6127880] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:48:33 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127880/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61ef9c0ff7524c24ba31d37f005fefc6 rgw multisite pubsub, test failures [6127882] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:20:05 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127882/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127882/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca05ed4cae38407888c96aef8016b691 Command failed on smithi200 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds'" [6127891] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:21:06 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127891/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127891/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9aba8b45b0d47aaa3547655fa7ac601 rgw multisite, test failures [6127900] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:48:12 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127900/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127900/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e935b80f4ea4e75a586ba74ee510a69 rgw multisite pubsub, test failures [6127910] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:20:44 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127910/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127910/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f47d53dc7e846a8a37c21f62a692766 rgw multisite, test failures Pass ================================================================= [6127878] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:15:30 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127878/ [6127879] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:08:19 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127879/ [6127881] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_latest}} time: 00:18:01 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127881/ [6127883] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127883/ [6127884] rgw/tools/{centos_latest cluster tasks} time: 00:18:43 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127884/ [6127885] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127885/ [6127886] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127886/ [6127887] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127887/ [6127888] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} time: 00:07:58 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127888/ [6127889] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} time: 00:10:42 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127889/ [6127890] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127890/ [6127892] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:16:20 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127892/ [6127893] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:25:31 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127893/ [6127894] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:12:28 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127894/ [6127895] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rhel_latest}} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127895/ [6127896] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:27 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127896/ [6127897] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:50 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127897/ [6127898] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127898/ [6127899] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127899/ [6127901] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127901/ [6127902] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:19:23 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127902/ [6127903] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127903/ [6127904] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:22:06 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127904/ [6127905] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:16:07 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127905/ [6127906] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:20 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127906/ [6127907] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:08:44 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127907/ [6127908] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:09:43 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127908/ [6127909] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:33 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127909/ [6127911] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127911/ [6127912] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:26:51 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127912/ [6127913] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127913/ [6127914] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:09:19 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127914/ [6127915] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:20 info: http://pulpito.ceph.com/yuriw-2021-05-21_18:42:12-rgw-octopus-distro-basic-smithi/6127915/