2021-09-20T15:11:33.508 INFO:root:teuthology version: 1.1.0-4e1f59de 2021-09-20T15:11:33.510 INFO:teuthology.results:subset: '5339/9999' 2021-09-20T15:11:33.510 INFO:teuthology.results:seed: '5076' 2021-09-20T17:44:17.190 INFO:root:teuthology version: 1.1.0-d3a488f5 2021-09-20T17:44:17.221 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-09-20T17:57:18.136 INFO:teuthology.results:Tests finished! gathering results... 2021-09-20T17:57:18.857 INFO:scrape:Found 15 jobs 2021-09-20T17:57:18.908 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376165/teuthology.log 2021-09-20T17:57:19.701 INFO:scrape:Found 2 distinct failure reasons 2021-09-20T17:57:19.701 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c73c082189c0f279d86688707294694fd83e97 2021-09-20T17:57:19.702 INFO:scrape:14 jobs: ['6376172', '6376158', '6376161', '6376168', '6376170', '6376167', '6376166', '6376163', '6376162', '6376169', '6376171', '6376164', '6376159', '6376160'] 2021-09-20T17:57:19.702 INFO:scrape:suites intersection: ['powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'thrashosds-health', 'whitelist_health}'] 2021-09-20T17:57:19.703 INFO:scrape:suites union: ['objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'supported-all-distro/rhel_8', 'supported-all-distro/ubuntu_latest', 'tasks/admin_socket_objecter_requests', 'tasks/cfuse_workunit_kernel_untar_build', 'tasks/cfuse_workunit_misc', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsx', 'tasks/cfuse_workunit_suites_fsync', 'tasks/cfuse_workunit_suites_pjd', 'tasks/cfuse_workunit_suites_truncate_delay', 'tasks/rados_api_tests', 'tasks/radosbench', 'tasks/readwrite', 'tasks/snaps-many-objects', 'thrashosds-health', 'whitelist_health}'] 2021-09-20T17:57:19.703 INFO:scrape: 2021-09-20T17:57:19.704 INFO:scrape:Dead: None 2021-09-20T17:57:19.704 INFO:scrape:1 jobs: ['6376165'] 2021-09-20T17:57:19.704 INFO:scrape: 2021-09-20T17:57:19.705 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/ failed: 14 dead: 1 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [6376158] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:04:48 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376158/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376158/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f517fd0fc35f4d5892fe569dfe8e6eb6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376159] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:10 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376159/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=338a164939e9432991be4df3f5a41c9d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =59c73c082189c0f279d86688707294694fd83e97 [6376160] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:51 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376160/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7dfc2d12243c4652a955f790d80b76fc Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376161] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:04:45 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376161/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376161/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3ae97e1666b47cda7ee5ca154c85f78 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376162] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:03 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376162/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376162/ sentry: https://sentry.ceph.com/organizations/ceph/?query=33dcb6b65a0c41398fab040205824e7e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =59c73c082189c0f279d86688707294694fd83e97 [6376163] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/radosbench thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:54 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376163/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376163/ sentry: https://sentry.ceph.com/organizations/ceph/?query=117bbc7152c94427bb1c64d90e609771 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376164] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/readwrite thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:04:57 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376164/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd987cac629142929b2b63874436de18 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376166] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/snaps-many-objects thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:53 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376166/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376166/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07eb2e8c032a47d094006f537acd342f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376167] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:04:51 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376167/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376167/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f967565545d44f4c86876444df645d7f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376168] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376168/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376168/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efe23f9d93dd4c789d2a7d44799a8111 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =59c73c082189c0f279d86688707294694fd83e97 [6376169] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:51 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376169/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e95e034c1c60444ea1afd3a119eef765 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376170] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:04:46 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376170/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376170/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b85efb9b41ed41a1be879e63262e70da Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 [6376171] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376171/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ac213ba737e44c5936ef280b4a33bdd Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =59c73c082189c0f279d86688707294694fd83e97 [6376172] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:51 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376172/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376172/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17bf51f85909487f9d6e9065834e563e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=59c 73c082189c0f279d86688707294694fd83e97 Dead ================================================================= [6376165] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-few-objects thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376165/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-05_12:15:02-powercycle-octopus-distro-basic-gibba/6376165/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds