2021-01-08T22:26:25.170 INFO:root:teuthology version: 1.0.0-77817aa4 2021-01-08T22:26:25.171 INFO:teuthology.results:subset: '1/3' 2021-01-08T22:26:25.171 INFO:teuthology.results:seed: '0' 2021-01-09T11:58:29.815 INFO:root:teuthology version: 1.0.0-77817aa4 2021-01-09T11:58:29.858 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-09T12:59:31.098 INFO:teuthology.results:Tests finished! gathering results... 2021-01-09T12:59:38.758 INFO:scrape:Found 61 jobs 2021-01-09T12:59:46.979 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:46.980 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:47.090 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:47.091 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:47.201 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:47.202 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:47.311 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:47.312 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:47.422 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:47.423 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:47.531 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:47.533 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:47.652 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:47.653 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:47.762 WARNING:scrape:Not-understood crash indication 2021-01-09T00:20:33.900 INFO:tasks.rgw.c2.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2021-01-09T12:59:47.763 WARNING:scrape:Not-understood crash indication 2021-01-09T12:59:49.510 INFO:scrape:Found 8 distinct failure reasons 2021-01-09T12:59:49.511 INFO:scrape:Failure: 2021-01-09T12:59:49.512 INFO:scrape:6 jobs: ['5764927', '5764906', '5764937', '5764917', '5764957', '5764947'] 2021-01-09T12:59:49.512 INFO:scrape:suites intersection: ['frontend/civetweb', 'overrides', 'rgw/singleton/{all/radosgw-admin'] 2021-01-09T12:59:49.513 INFO:scrape:suites union: ['frontend/civetweb', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}'] 2021-01-09T12:59:49.513 INFO:scrape: 2021-01-09T12:59:49.513 INFO:scrape:Failure: Command failed on smithi109 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2021-01-09T12:59:49.514 INFO:scrape:2 jobs: ['5764920', '5764950'] 2021-01-09T12:59:49.514 INFO:scrape:suites intersection: ['frontend/civetweb', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'tasks/rgw_ragweed}'] 2021-01-09T12:59:49.515 INFO:scrape:suites union: ['frontend/civetweb', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'tasks/rgw_ragweed}'] 2021-01-09T12:59:49.515 INFO:scrape: 2021-01-09T12:59:49.515 INFO:scrape:Failure: Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi170 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=24439d54d2f8b45bf0a4f43869db825ea90914cd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh' 2021-01-09T12:59:49.516 INFO:scrape:1 jobs: ['5764910'] 2021-01-09T12:59:49.516 INFO:scrape:suites: ['cluster', 'rgw/tools/{centos_latest', 'tasks}'] 2021-01-09T12:59:49.517 INFO:scrape: 2021-01-09T12:59:49.517 INFO:scrape:Failure: [Errno 13] Permission denied: '/home/dgalloway' 2021-01-09T12:59:49.518 INFO:scrape:2 jobs: ['5764922', '5764905'] 2021-01-09T12:59:49.518 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-01-09T12:59:49.518 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-01-09T12:59:49.519 INFO:scrape: 2021-01-09T12:59:49.519 INFO:scrape:Failure: "2021-01-09T12:09:35.263958+0000 mon.b (mon.0) 178 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2021-01-09T12:59:49.520 INFO:scrape:2 jobs: ['5764961', '5764925'] 2021-01-09T12:59:49.521 INFO:scrape:suites intersection: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec'] 2021-01-09T12:59:49.521 INFO:scrape:suites union: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'tasks/rgw_s3tests}', 'tasks/rgw_user_quota}'] 2021-01-09T12:59:49.522 INFO:scrape: 2021-01-09T12:59:49.522 INFO:scrape:Failure: rgw multisite pubsub, test failures 2021-01-09T12:59:49.523 INFO:scrape:1 jobs: ['5764936'] 2021-01-09T12:59:49.524 INFO:scrape:suites: ['frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-01-09T12:59:49.524 INFO:scrape: 2021-01-09T12:59:49.524 INFO:scrape:Failure: Command failed on smithi172 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2021-01-09T12:59:49.525 INFO:scrape:1 jobs: ['5764908'] 2021-01-09T12:59:49.525 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-01-09T12:59:49.526 INFO:scrape: 2021-01-09T12:59:49.526 INFO:scrape:Failure: Cannot create secret 2021-01-09T12:59:49.526 INFO:scrape:1 jobs: ['5764902'] 2021-01-09T12:59:49.527 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2021-01-09T12:59:49.527 INFO:scrape: