2021-05-13T02:49:39.965 INFO:root:teuthology version: 1.1.0-19220a3b 2021-05-13T02:49:39.966 INFO:teuthology.results:subset: '111/120000' 2021-05-13T02:49:39.967 INFO:teuthology.results:seed: '3797' 2021-05-13T03:12:24.971 INFO:root:teuthology version: 1.1.0-19220a3b 2021-05-13T03:12:24.975 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-05-13T04:00:28.473 INFO:teuthology.results:Tests finished! gathering results... 2021-05-13T04:00:31.437 INFO:scrape:Found 39 jobs 2021-05-13T04:00:32.051 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.431 INFO:tasks.rgw.c1.client.1.smithi028.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.052 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.448 INFO:tasks.rgw.c2.client.0.smithi084.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.053 WARNING:scrape:Not-understood crash indication 2021-05-13T04:00:32.087 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.431 INFO:tasks.rgw.c1.client.1.smithi028.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.089 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.448 INFO:tasks.rgw.c2.client.0.smithi084.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.089 WARNING:scrape:Not-understood crash indication 2021-05-13T04:00:32.129 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.431 INFO:tasks.rgw.c1.client.1.smithi028.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.130 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.448 INFO:tasks.rgw.c2.client.0.smithi084.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.131 WARNING:scrape:Not-understood crash indication 2021-05-13T04:00:32.182 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.431 INFO:tasks.rgw.c1.client.1.smithi028.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.184 WARNING:scrape:Not-understood crash indication 2021-05-13T03:28:54.448 INFO:tasks.rgw.c2.client.0.smithi084.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.185 WARNING:scrape:Not-understood crash indication 2021-05-13T04:00:32.846 WARNING:scrape:Not-understood crash indication 2021-05-13T03:42:04.964 INFO:tasks.rgw.c1.client.1.smithi058.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.847 WARNING:scrape:Not-understood crash indication 2021-05-13T03:42:05.061 INFO:tasks.rgw.c2.client.0.smithi095.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.848 WARNING:scrape:Not-understood crash indication 2021-05-13T04:00:32.889 WARNING:scrape:Not-understood crash indication 2021-05-13T03:42:04.964 INFO:tasks.rgw.c1.client.1.smithi058.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.890 WARNING:scrape:Not-understood crash indication 2021-05-13T03:42:05.061 INFO:tasks.rgw.c2.client.0.smithi095.stderr:daemon-helper: command crashed with signal 11 2021-05-13T04:00:32.890 WARNING:scrape:Not-understood crash indication 2021-05-13T04:00:32.891 INFO:scrape:Found 3 distinct failure reasons 2021-05-13T04:00:32.892 INFO:scrape:Failure: Cannot create secret 2021-05-13T04:00:32.892 INFO:scrape:1 jobs: ['6112472'] 2021-05-13T04:00:32.893 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2021-05-13T04:00:32.893 INFO:scrape: 2021-05-13T04:00:32.893 INFO:scrape:Failure: rgw multisite, rgw multisite pubsub, test failures 2021-05-13T04:00:32.894 INFO:scrape:2 jobs: ['6112475', '6112495'] 2021-05-13T04:00:32.894 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-05-13T04:00:32.895 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-05-13T04:00:32.895 INFO:scrape: 2021-05-13T04:00:32.896 INFO:scrape:Failure: Command failed on smithi093 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2021-05-13T04:00:32.896 INFO:scrape:1 jobs: ['6112477'] 2021-05-13T04:00:32.897 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-05-13T04:00:32.897 INFO:scrape: 2021-05-13T04:00:32.899 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 35 Fail ================================================================= [6112472] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112472/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112472/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0bd9cabb8e5463dacf0489f0bd3606b Cannot create secret [6112475] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:47:46 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112475/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112475/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea7289541fa64b188eda049bea2dde2d rgw multisite, rgw multisite pubsub, test failures [6112477] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112477/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112477/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7aa87aeb4a26460c909f0aeb53625596 Command failed on smithi093 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds'" [6112495] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:49:26 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112495/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112495/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b3f1007376064f328a8637d9f2d45828 rgw multisite, rgw multisite pubsub, test failures Pass ================================================================= [6112473] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112473/ [6112474] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:08:34 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112474/ [6112476] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} time: 00:10:46 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112476/ [6112478] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112478/ [6112479] rgw/tools/{centos_latest cluster tasks} time: 00:19:21 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112479/ [6112480] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:21:32 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112480/ [6112481] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:16:00 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112481/ [6112482] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:29 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112482/ [6112483] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} time: 00:07:53 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112483/ [6112484] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112484/ [6112485] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:18 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112485/ [6112486] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:20:54 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112486/ [6112487] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:16:33 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112487/ [6112488] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:27:24 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112488/ [6112489] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112489/ [6112490] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rhel_latest}} time: 00:16:58 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112490/ [6112491] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112491/ [6112492] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112492/ [6112493] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112493/ [6112494] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112494/ [6112496] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_latest}} time: 00:17:17 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112496/ [6112497] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:19:35 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112497/ [6112498] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:21 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112498/ [6112499] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:22:17 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112499/ [6112500] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:47 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112500/ [6112501] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:10:46 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112501/ [6112502] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:08:51 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112502/ [6112503] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_latest}} time: 00:17:23 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112503/ [6112504] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:32 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112504/ [6112505] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:21:15 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112505/ [6112506] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:16:12 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112506/ [6112507] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:26:52 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112507/ [6112508] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112508/ [6112509] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_latest}} time: 00:17:24 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112509/ [6112510] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2021-05-12_22:29:52-rgw-wip-yuri3-testing-2021-05-12-1004-octopus-distro-basic-smithi/6112510/