2021-06-22T22:00:52.421 INFO:root:teuthology version: 1.1.0-26631ede 2021-06-22T22:00:52.423 INFO:teuthology.results:subset: '260/9999' 2021-06-22T22:00:52.423 INFO:teuthology.results:seed: '9413' 2021-06-22T22:11:30.135 INFO:root:teuthology version: 1.1.0-26631ede 2021-06-22T22:11:30.139 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-06-22T22:38:31.996 INFO:teuthology.results:Tests finished! gathering results... 2021-06-22T22:38:32.408 INFO:scrape:Found 15 jobs 2021-06-22T22:38:32.506 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143200/teuthology.log 2021-06-22T22:38:32.554 INFO:scrape:Found 2 distinct failure reasons 2021-06-22T22:38:32.555 INFO:scrape:Failure: Command failed on gibba001 with status 100: 'sudo apt-get clean' 2021-06-22T22:38:32.555 INFO:scrape:3 jobs: ['6143192', '6143197', '6143189'] 2021-06-22T22:38:32.556 INFO:scrape:suites intersection: ['powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'thrashosds-health', 'whitelist_health}'] 2021-06-22T22:38:32.556 INFO:scrape:suites union: ['objectstore/bluestore-bitmap', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'supported-all-distro/rhel_8.2', 'supported-all-distro/ubuntu_latest', 'tasks/admin_socket_objecter_requests', 'tasks/cfuse_workunit_suites_fsx', 'tasks/readwrite', 'thrashosds-health', 'whitelist_health}'] 2021-06-22T22:38:32.557 INFO:scrape: 2021-06-22T22:38:32.557 INFO:scrape:Dead: None 2021-06-22T22:38:32.558 INFO:scrape:11 jobs: ['6143200', '6143187', '6143194', '6143195', '6143190', '6143186', '6143188', '6143199', '6143198', '6143193', '6143196'] 2021-06-22T22:38:32.558 INFO:scrape: 2021-06-22T22:38:32.559 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/ failed: 3 dead: 11 running: 0 waiting: 0 queued: 0 passed: 1 Fail ================================================================= [6143189] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_8 tasks/readwrite thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143189/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e03e21fe7b64f4d872f0fdcde863263 Command failed on gibba036 with status 1: 'sudo yum install -y kernel' [6143192] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143192/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd9283e8ae3b4892b7daafe2fd4edb3d Command failed on gibba001 with status 100: 'sudo apt-get clean' [6143197] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8.2 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143197/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143197/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e11d419f7db24aa590ab50701ec03af1 Command failed on gibba036 with status 100: 'sudo apt-get clean' Dead ================================================================= [6143186] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143186/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143186/ Error reimaging machines: Failed to power on gibba034 [6143187] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8.2 tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143187/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143187/ Error reimaging machines: Failed to power on gibba034 [6143188] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/ubuntu_latest tasks/radosbench thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143188/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143188/ Error reimaging machines: Failed to power on gibba034 [6143190] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8.2 tasks/snaps-few-objects thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143190/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143190/ Error reimaging machines: Failed to power on gibba034 [6143193] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143193/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143193/ Error reimaging machines: Failed to power on gibba034 [6143194] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8.2 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143194/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143194/ Error reimaging machines: Failed to power on gibba034 [6143195] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143195/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143195/ Error reimaging machines: Failed to power on gibba034 [6143196] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143196/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143196/ Error reimaging machines: Failed to power on gibba034 [6143198] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143198/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143198/ Error reimaging machines: Failed to power on gibba034 [6143199] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143199/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143199/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [6143200] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8.2 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143200/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143200/ Error reimaging machines: Failed to power on gibba034 Pass ================================================================= [6143191] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:23:44 info: http://pulpito.ceph.com/teuthology-2021-05-30_12:15:02-powercycle-octopus-distro-basic-gibba/6143191/