2021-01-31T02:52:04.731 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-31T02:52:04.732 INFO:teuthology.results:subset: '1/9' 2021-01-31T02:52:04.732 INFO:teuthology.results:seed: '1160' 2021-01-31T04:39:23.494 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-31T04:39:23.597 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-31T05:08:24.113 INFO:teuthology.results:Tests finished! gathering results... 2021-01-31T05:08:26.901 INFO:scrape:Found 47 jobs 2021-01-31T05:08:30.026 INFO:scrape:Found 5 distinct failure reasons 2021-01-31T05:08:30.027 INFO:scrape:Failure: Command failed (workunit test rgw/run-reshard.sh) on gibba029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ef059353acdf04f418bc3b7e658a615201f91c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh' 2021-01-31T05:08:30.028 INFO:scrape:6 jobs: ['5843193', '5843220', '5843212', '5843206', '5843186', '5843174'] 2021-01-31T05:08:30.028 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 's3tests-java', 's3tests}', 'tasks/{0-install'] 2021-01-31T05:08:30.029 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}'] 2021-01-31T05:08:30.029 INFO:scrape: 2021-01-31T05:08:30.030 INFO:scrape:Failure: rgw multisite, test failures 2021-01-31T05:08:30.030 INFO:scrape:2 jobs: ['5843201', '5843177'] 2021-01-31T05:08:30.031 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-01-31T05:08:30.031 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-01-31T05:08:30.031 INFO:scrape: 2021-01-31T05:08:30.032 INFO:scrape:Failure: Command failed on gibba044 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2021-01-31T05:08:30.032 INFO:scrape:2 jobs: ['5843204', '5843180'] 2021-01-31T05:08:30.033 INFO:scrape:suites intersection: ['overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-01-31T05:08:30.033 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-01-31T05:08:30.033 INFO:scrape: 2021-01-31T05:08:30.034 INFO:scrape:Failure: Command failed on gibba041 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2021-01-31T05:08:30.034 INFO:scrape:2 jobs: ['5843184', '5843216'] 2021-01-31T05:08:30.035 INFO:scrape:suites intersection: ['frontend/civetweb', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'tasks/rgw_ragweed}'] 2021-01-31T05:08:30.035 INFO:scrape:suites union: ['frontend/civetweb', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'tasks/rgw_ragweed}'] 2021-01-31T05:08:30.035 INFO:scrape: 2021-01-31T05:08:30.036 INFO:scrape:Failure: "2021-01-31T04:21:10.917013+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2021-01-31T05:08:30.036 INFO:scrape:1 jobs: ['5843203'] 2021-01-31T05:08:30.037 INFO:scrape:suites: ['clusters/fixed-2', 'frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/sts/{centos_latest', 'rgw_pool_type/ec-profile', 'ststests', 'tasks/{0-install', 'webidentity}}'] 2021-01-31T05:08:30.037 INFO:scrape: