2021-04-07T17:17:35.950 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-07T17:17:35.951 INFO:teuthology.results:subset: '0/30000' 2021-04-07T17:17:35.952 INFO:teuthology.results:seed: '463' 2021-04-07T17:19:09.310 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-07T17:19:09.314 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-04-07T21:24:30.849 INFO:teuthology.results:Tests finished! gathering results... 2021-04-07T21:24:34.975 INFO:scrape:Found 47 jobs 2021-04-07T21:24:35.294 WARNING:scrape:Not-understood crash indication 2021-04-07T17:42:38.990 INFO:tasks.rgw.client.0.smithi203.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:35.295 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:35.371 WARNING:scrape:Not-understood crash indication 2021-04-07T17:42:38.990 INFO:tasks.rgw.client.0.smithi203.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:35.372 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:35.458 WARNING:scrape:Not-understood crash indication 2021-04-07T17:42:38.990 INFO:tasks.rgw.client.0.smithi203.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:35.459 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:35.685 WARNING:scrape:Not-understood crash indication 2021-04-07T17:47:08.874 INFO:tasks.rgw.client.0.smithi159.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:35.686 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:36.002 WARNING:scrape:Not-understood crash indication 2021-04-07T17:42:38.629 INFO:tasks.rgw.client.0.smithi098.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.003 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:36.216 WARNING:scrape:Not-understood crash indication 2021-04-07T17:39:00.234 INFO:tasks.rgw.client.0.smithi061.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.217 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:36.329 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.389 INFO:tasks.rgw.c1.client.0.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.329 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.393 INFO:tasks.rgw.c1.client.1.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.330 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.427 INFO:tasks.rgw.c2.client.1.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.330 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.428 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.331 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:36.346 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.389 INFO:tasks.rgw.c1.client.0.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.347 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.393 INFO:tasks.rgw.c1.client.1.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.347 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.427 INFO:tasks.rgw.c2.client.1.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.348 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.428 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.348 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:36.363 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.389 INFO:tasks.rgw.c1.client.0.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.364 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.393 INFO:tasks.rgw.c1.client.1.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.364 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.427 INFO:tasks.rgw.c2.client.1.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.365 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.428 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.365 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:36.380 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.389 INFO:tasks.rgw.c1.client.0.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.381 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.393 INFO:tasks.rgw.c1.client.1.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.382 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.427 INFO:tasks.rgw.c2.client.1.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.382 WARNING:scrape:Not-understood crash indication 2021-04-07T17:40:58.428 INFO:tasks.rgw.c2.client.0.smithi093.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:36.383 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:37.429 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.758 INFO:tasks.rgw.c1.client.0.smithi003.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.430 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.759 INFO:tasks.rgw.c1.client.1.smithi003.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.430 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.769 INFO:tasks.rgw.c2.client.0.smithi044.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.431 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.770 INFO:tasks.rgw.c2.client.1.smithi044.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.431 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:37.447 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.758 INFO:tasks.rgw.c1.client.0.smithi003.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.448 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.759 INFO:tasks.rgw.c1.client.1.smithi003.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.448 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.769 INFO:tasks.rgw.c2.client.0.smithi044.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.449 WARNING:scrape:Not-understood crash indication 2021-04-07T17:34:50.770 INFO:tasks.rgw.c2.client.1.smithi044.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.449 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:37.660 WARNING:scrape:Not-understood crash indication 2021-04-07T17:38:01.583 INFO:tasks.rgw.client.0.smithi199.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:37.661 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:38.097 WARNING:scrape:Not-understood crash indication 2021-04-07T17:41:02.851 INFO:tasks.rgw.client.0.smithi204.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:38.098 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:38.764 WARNING:scrape:Not-understood crash indication 2021-04-07T17:43:04.651 INFO:tasks.rgw.client.0.smithi023.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:38.765 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:39.845 WARNING:scrape:Not-understood crash indication 2021-04-07T17:44:20.443 INFO:tasks.rgw.client.0.smithi008.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:39.846 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:40.081 WARNING:scrape:Not-understood crash indication 2021-04-07T17:42:10.427 INFO:tasks.rgw.client.0.smithi136.stderr:daemon-helper: command crashed with signal 11 2021-04-07T21:24:40.082 WARNING:scrape:Not-understood crash indication 2021-04-07T21:24:40.083 INFO:scrape:Found 7 distinct failure reasons 2021-04-07T21:24:40.084 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi203 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" 2021-04-07T21:24:40.084 INFO:scrape:9 jobs: ['6027301', '6027287', '6027314', '6027308', '6027312', '6027330', '6027306', '6027328', '6027323'] 2021-04-07T21:24:40.085 INFO:scrape:suites intersection: [] 2021-04-07T21:24:40.085 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '2-kms/kmip', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_old', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}', 'clusters/fixed-2', 'frontend/civetweb', 'ignore-pg-availability', 'ignore-pg-availability}', 'install', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multifs/{clusters/fixed-2', 'rgw/thrash/{civetweb', 'rgw_pool_type/ec-profile', 'tasks/rgw_s3tests}', 'thrasher/default', 'thrashosds-health', 'workload/rgw_s3tests}'] 2021-04-07T21:24:40.086 INFO:scrape: 2021-04-07T21:24:40.086 INFO:scrape:Failure: 2021-04-07T21:24:40.087 INFO:scrape:2 jobs: ['6027326', '6027291'] 2021-04-07T21:24:40.087 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-04-07T21:24:40.088 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-04-07T21:24:40.088 INFO:scrape: 2021-04-07T21:24:40.089 INFO:scrape:Failure: too many values to unpack (expected 1) 2021-04-07T21:24:40.089 INFO:scrape:2 jobs: ['6027305', '6027327'] 2021-04-07T21:24:40.090 INFO:scrape:suites intersection: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/rgw_cephadm'] 2021-04-07T21:24:40.090 INFO:scrape:suites union: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/rgw_cephadm', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}'] 2021-04-07T21:24:40.090 INFO:scrape: 2021-04-07T21:24:40.091 INFO:scrape:Failure: list index out of range 2021-04-07T21:24:40.091 INFO:scrape:1 jobs: ['6027289'] 2021-04-07T21:24:40.092 INFO:scrape:suites: ['rgw/ignore-pg-availability'] 2021-04-07T21:24:40.092 INFO:scrape: 2021-04-07T21:24:40.093 INFO:scrape:Failure: Command failed on smithi002 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2021-04-07T21:24:40.093 INFO:scrape:1 jobs: ['6027295'] 2021-04-07T21:24:40.094 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-04-07T21:24:40.094 INFO:scrape: 2021-04-07T21:24:40.094 INFO:scrape:Crash: 2021-04-07T21:24:40.095 INFO:scrape:ceph version 17.0.0-2839-gb3f41266 (b3f41266c5e2529601e12a5496e79c672c42f1ad) quincy (dev) 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f1ad1295980] 2: pthread_mutex_lock() 3: (RGWCurlHandles::get_curl_handle()+0x25) [0x559822d50495] 4: (RGWHTTPClient::init_request(rgw_http_req_data*)+0x55) [0x559822d51cd5] 5: (RGWHTTPManager::add_request(RGWHTTPClient*)+0x105) [0x559822d54775] 6: (RGWHTTP::send(RGWHTTPClient*)+0x1c) [0x559822d5486c] 7: (RGWHTTP::process(RGWHTTPClient*, optional_yield)+0x18) [0x559822d54898] 8: (RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::v15_2_0::list*, ceph::buffer::v15_2_0::list*, optional_yield)+0xb56) [0x5598230633d6] 9: (RGWRESTConn::forward(rgw_user const&, req_info&, obj_version*, unsigned long, ceph::buffer::v15_2_0::list*, ceph::buffer::v15_2_0::list*, optional_yield)+0x3a6) [0x559823068d26] 10: (RGWPeriodPuller::pull(std::__cxx11::basic_string, std::allocator > const&, RGWPeriod&, optional_yield)+0x6c3) [0x559822f41733] 11: (RGWSI_MDLog::find_oldest_period(optional_yield)+0x36f) [0x559822cabf8f] 12: (RGWSI_MDLog::init_oldest_log_period(optional_yield, DoutPrefixProvider const*)+0x5fc) [0x559822cacf1c] 13: (RGWSI_MDLog::do_start(optional_yield, DoutPrefixProvider const*)+0x10c) [0x559822cad73c] 14: (RGWServiceInstance::start(optional_yield, DoutPrefixProvider const*)+0x1c) [0x559822cdfebc] 15: (RGWServices_Def::init(ceph::common::CephContext*, bool, bool, bool, optional_yield, DoutPrefixProvider const*)+0x1939) [0x559822ce2519] 16: (RGWServices::do_init(ceph::common::CephContext*, bool, bool, bool, optional_yield, DoutPrefixProvider const*)+0x22) [0x559822ce3c62] 17: (RGWRados::init_svc(bool, DoutPrefixProvider const*)+0x53) [0x559822fe4913] 18: (RGWRados::initialize(DoutPrefixProvider const*)+0x170) [0x55982302fdc0] 19: (RGWStoreManager::init_storage_provider(DoutPrefixProvider const*, ceph::common::CephContext*, std::__cxx11::basic_string, std::allocator >, bool, bool, bool, bool, bool, bool)+0x88) [0x5598230fdc98] 20: main() 21: __libc_start_main() 22: _start() 2021-04-07T21:24:40.095 INFO:scrape:2 jobs: ['6027304', '6027315'] 2021-04-07T21:24:40.096 INFO:scrape:suites intersection: ['frontend/civetweb', 'ignore-pg-availability', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-04-07T21:24:40.096 INFO:scrape:suites union: ['frontend/civetweb', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-04-07T21:24:40.096 INFO:scrape: 2021-04-07T21:24:40.097 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh 2021-04-07T21:24:40.097 INFO:scrape:1 jobs: ['6027297'] 2021-04-07T21:24:40.098 INFO:scrape:suites: ['cluster', 'rgw/tools/{centos_latest', 'tasks}'] 2021-04-07T21:24:40.098 INFO:scrape: 2021-04-07T21:24:40.101 INFO:teuthology.results:Sending results to aemerson@redhat.com: Test Run: aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/ failed: 18 dead: 0 running: 0 waiting: 0 queued: 0 passed: 29 Fail ================================================================= [6027287] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} ----------------------------------------------------------------- time: 00:22:06 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027287/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027287/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46652659194e4bcb8bbd3ba981bc2315 Command failed (s3 tests against rgw) on smithi159 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027289] rgw/ignore-pg-availability ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027289/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027289/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31c6440def5b45698565bd9c77ea0b17 list index out of range [6027291] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:12:12 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027291/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027291/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5d0b1ab440941f3bd07f6cdbdd6e575 [6027295] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:20:04 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027295/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027295/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47c637ee8c9f42b6938e2c3cc663b5ed Command failed on smithi002 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds'" [6027297] rgw/tools/{centos_latest cluster tasks} ----------------------------------------------------------------- time: 03:52:09 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027297/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027297/ sentry: https://sentry.ceph.com/organizations/ceph/?query=98b7eddd803047e28e1716a26f172554 Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi124 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3f41266c5e2529601e12a5496e79c672c42f1ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh' [6027301] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} ----------------------------------------------------------------- time: 00:15:56 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027301/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027301/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bea60ef216234f64b6067dc55e0c21c7 Command failed (s3 tests against rgw) on smithi203 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027304] rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:10:24 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027304/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027304/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e268a013c8d247c7800811c88b72cfba [6027305] rgw/singleton/{all/rgw_cephadm frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027305/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027305/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b3baa7857b5047c2923c23986d46d892 too many values to unpack (expected 1) [6027306] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:20:19 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027306/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027306/ sentry: https://sentry.ceph.com/organizations/ceph/?query=928042e4814c478583b86f93a1d0187a Command failed (s3 tests against rgw) on smithi023 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027308] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} ----------------------------------------------------------------- time: 00:14:06 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027308/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027308/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ab5192d75094187be50fcdb2d6ccde6 Command failed (s3 tests against rgw) on smithi061 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027312] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} ----------------------------------------------------------------- time: 00:13:32 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027312/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027312/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ef9e9e11de14630b7f61ebfd08ecd73 Command failed (s3 tests against rgw) on smithi199 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027314] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} ----------------------------------------------------------------- time: 00:16:38 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027314/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027314/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a302a6d61314237b74e400dc03cda1f Command failed (s3 tests against rgw) on smithi098 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027315] rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:10:48 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027315/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027315/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d614f7f1733c4b668867d7b249ce2047 [6027323] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} ----------------------------------------------------------------- time: 00:15:27 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027323/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027323/ sentry: https://sentry.ceph.com/organizations/ceph/?query=395dcc80de8049af8f35e99b5810e947 Command failed (s3 tests against rgw) on smithi136 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027326] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:14:20 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027326/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027326/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df300df8789f471bb8c02e8590254bed [6027327] rgw/singleton/{all/rgw_cephadm frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027327/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027327/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c58266035a474af0a33b6d9cbc644952 too many values to unpack (expected 1) [6027328] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:19:39 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027328/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027328/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf888940a753484e8e2c370586b08d22 Command failed (s3 tests against rgw) on smithi008 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6027330] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} ----------------------------------------------------------------- time: 00:14:51 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027330/ log: http://qa-proxy.ceph.com/teuthology/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027330/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b3e02563f204a56b0f0314dd52877e3 Command failed (s3 tests against rgw) on smithi204 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" Pass ================================================================= [6027288] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:17:13 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027288/ [6027290] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} time: 00:09:36 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027290/ [6027292] rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-random-distro$/{centos_8} tasks/{0-install test_kafka}} time: 00:28:39 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027292/ [6027293] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:20:06 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027293/ [6027294] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} time: 00:27:39 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027294/ [6027296] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:15:23 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027296/ [6027298] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:31 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027298/ [6027299] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:18:50 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027299/ [6027300] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:12:24 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027300/ [6027302] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_multipart_upload} time: 00:11:31 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027302/ [6027303] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} time: 00:27:17 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027303/ [6027307] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 00:49:50 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027307/ [6027309] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_ragweed} time: 00:09:38 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027309/ [6027310] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} time: 00:28:12 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027310/ [6027311] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:14:06 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027311/ [6027313] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:17:05 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027313/ [6027316] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:11:55 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027316/ [6027317] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} time: 00:28:06 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027317/ [6027318] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:20:36 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027318/ [6027319] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:16:16 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027319/ [6027320] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:31:04 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027320/ [6027321] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:17:27 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027321/ [6027322] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:15:08 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027322/ [6027324] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_user_quota} time: 00:11:37 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027324/ [6027325] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} time: 00:28:45 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027325/ [6027329] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 00:51:26 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027329/ [6027331] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} time: 00:11:57 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027331/ [6027332] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} time: 00:27:53 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027332/ [6027333] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:15:11 info: http://pulpito.ceph.com/aemerson-2021-04-07_17:17:17-rgw-wip-49615-distro-basic-smithi/6027333/