2020-08-25T22:06:23.704 INFO:root:teuthology version: 1.0.0-3b2e857 2020-08-25T22:06:23.705 INFO:teuthology.results:seed: '3910' 2020-08-25T23:02:41.674 INFO:root:teuthology version: 1.0.0-3b2e857 2020-08-25T23:02:41.700 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-08-25T23:34:42.697 INFO:teuthology.results:Tests finished! gathering results... 2020-08-25T23:35:10.716 INFO:scrape:Found 107 jobs 2020-08-25T23:36:13.740 INFO:scrape:Found 6 distinct failure reasons 2020-08-25T23:36:13.743 INFO:scrape:Failure: Command failed (ragweed tests against rgw) on smithi165 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'" 2020-08-25T23:36:13.743 INFO:scrape:54 jobs 2020-08-25T23:36:13.745 INFO:scrape:suites intersection: ['overrides'] 2020-08-25T23:36:13.746 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/multifs/{clusters/fixed-2', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/rgw_ragweed}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}'] 2020-08-25T23:36:13.747 INFO:scrape: 2020-08-25T23:36:13.748 INFO:scrape:Failure: rgw multisite, test failures 2020-08-25T23:36:13.748 INFO:scrape:4 jobs: ['5375508', '5375482', '5375454', '5375535'] 2020-08-25T23:36:13.749 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2020-08-25T23:36:13.749 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2020-08-25T23:36:13.749 INFO:scrape: 2020-08-25T23:36:13.750 INFO:scrape:Failure: Command failed on smithi121 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2020-08-25T23:36:13.750 INFO:scrape:2 jobs: ['5375456', '5375510'] 2020-08-25T23:36:13.751 INFO:scrape:suites intersection: ['overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2020-08-25T23:36:13.751 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2020-08-25T23:36:13.752 INFO:scrape: 2020-08-25T23:36:13.752 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi143 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!s3select,!fails_with_subdomain'" 2020-08-25T23:36:13.752 INFO:scrape:13 jobs: ['5375553', '5375534', '5375538', '5375485', '5375513', '5375460', '5375520', '5375536', '5375483', '5375481', '5375467', '5375500', '5375505'] 2020-08-25T23:36:13.753 INFO:scrape:suites intersection: [] 2020-08-25T23:36:13.753 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}}', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'http', 'install', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multifs/{clusters/fixed-2', 'rgw/thrash/{civetweb', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'tasks/rgw_s3tests}', 'tasks/s3tests-website', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest}', 'workload/rgw_s3tests}'] 2020-08-25T23:36:13.754 INFO:scrape: 2020-08-25T23:36:13.754 INFO:scrape:Failure: "2020-08-25T23:12:27.407100+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-08-25T23:36:13.755 INFO:scrape:1 jobs: ['5375544'] 2020-08-25T23:36:13.755 INFO:scrape:suites: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/replicated', 'supported-random-distro$/{ubuntu_latest}}'] 2020-08-25T23:36:13.755 INFO:scrape: 2020-08-25T23:36:13.756 INFO:scrape:Failure: Cannot create secret 2020-08-25T23:36:13.756 INFO:scrape:1 jobs: ['5375451'] 2020-08-25T23:36:13.757 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2020-08-25T23:36:13.757 INFO:scrape: