2020-11-24T20:58:19.659 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-24T20:58:19.662 INFO:teuthology.results:subset: '1/1000' 2020-11-24T20:58:19.662 INFO:teuthology.results:seed: '1505' 2020-11-24T21:51:37.157 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-24T21:51:37.216 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-24T22:18:37.784 INFO:teuthology.results:Tests finished! gathering results... 2020-11-24T22:18:41.826 INFO:scrape:Found 39 jobs 2020-11-24T22:18:42.437 INFO:scrape:Found 2 distinct failure reasons 2020-11-24T22:18:42.438 INFO:scrape:Failure: rgw multisite, test failures 2020-11-24T22:18:42.438 INFO:scrape:1 jobs: ['5654457'] 2020-11-24T22:18:42.439 INFO:scrape:suites: ['frontend/civetweb', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2020-11-24T22:18:42.439 INFO:scrape: 2020-11-24T22:18:42.440 INFO:scrape:Failure: Command failed on smithi118 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack service create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi118.front.sepia.ceph.com:35357/v3 --description 'Swift Service' --name swift object-store --debug" 2020-11-24T22:18:42.440 INFO:scrape:3 jobs: ['5654468', '5654443', '5654448'] 2020-11-24T22:18:42.440 INFO:scrape:suites intersection: [] 2020-11-24T22:18:42.441 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'frontend/beast', 'frontend/civetweb', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2020-11-24T22:18:42.441 INFO:scrape: 2020-11-24T22:18:42.448 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 35 Fail ================================================================= [5654443] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654443/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654443/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf5ccaecd2a3494c9727c452cc451915 Command failed on smithi071 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --os-username admin --os-password ADMIN --os-user- domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi071.front.sepia.ceph.com:35357/v3 --description 'Encryption Tenant' --domain default rgwcrypt --debug" [5654448] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:10:19 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654448/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654448/ sentry: https://sentry.ceph.com/organizations/ceph/?query=96db14ef70b747e2a09a98240c527173 Command failed on smithi003 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack service create --os-username admin --os-password ADMIN --os-user- domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi003.front.sepia.ceph.com:35357/v3 --description 'Swift Service' --name swift object-store --debug" [5654457] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:22:29 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654457/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654457/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84989d2b9f7747609438e7b89dfb463c rgw multisite, test failures [5654468] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:10:18 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654468/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654468/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e2129cfe25d4b47aec448c4934ac5e0 Command failed on smithi118 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack service create --os-username admin --os-password ADMIN --os-user- domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi118.front.sepia.ceph.com:35357/v3 --description 'Swift Service' --name swift object-store --debug" Pass ================================================================= [5654442] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:22:42 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654442/ [5654444] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:14:01 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654444/ [5654445] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:06:55 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654445/ [5654446] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} time: 00:37:27 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654446/ [5654447] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:08:24 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654447/ [5654449] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654449/ [5654450] rgw/tools/{centos_latest cluster tasks} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654450/ [5654451] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654451/ [5654452] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:09:34 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654452/ [5654453] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} time: 00:06:21 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654453/ [5654454] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:08:11 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654454/ [5654455] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:24:53 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654455/ [5654456] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:59 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654456/ [5654458] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654458/ [5654459] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654459/ [5654460] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rhel_latest}} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654460/ [5654461] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654461/ [5654462] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:23:47 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654462/ [5654463] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:16 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654463/ [5654464] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654464/ [5654465] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:06:15 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654465/ [5654466] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} time: 00:38:36 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654466/ [5654467] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_latest}} time: 00:14:01 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654467/ [5654469] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:10:59 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654469/ [5654470] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654470/ [5654471] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654471/ [5654472] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:07:32 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654472/ [5654473] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654473/ [5654474] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:24:08 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654474/ [5654475] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:03 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654475/ [5654476] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:22:34 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654476/ [5654477] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654477/ [5654478] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:06:26 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654478/ [5654479] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:07:54 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654479/ [5654480] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:09:55 info: http://pulpito.ceph.com/yuriw-2020-11-24_20:57:03-rgw-wip-yuri5-testing-2020-11-24-0941-octopus-distro-basic-smithi/5654480/