2021-02-27T17:53:02.291 INFO:root:teuthology version: 1.1.0-933811f3 2021-02-27T17:53:02.292 INFO:teuthology.results:subset: '55/100000' 2021-02-27T17:53:02.293 INFO:teuthology.results:seed: '3981' 2021-02-27T19:00:22.953 INFO:root:teuthology version: 1.1.0-933811f3 2021-02-27T19:00:22.983 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-02-27T19:32:25.350 INFO:teuthology.results:Tests finished! gathering results... 2021-02-27T19:32:29.202 INFO:scrape:Found 15 jobs 2021-02-27T19:32:29.203 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911818/teuthology.log 2021-02-27T19:32:29.207 INFO:scrape:Found 2 distinct failure reasons 2021-02-27T19:32:29.208 INFO:scrape:Dead: None 2021-02-27T19:32:29.208 INFO:scrape:4 jobs: ['5911818', '5911808', '5911815', '5911811'] 2021-02-27T19:32:29.209 INFO:scrape: 2021-02-27T19:32:29.209 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on gibba026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3a09e186830765c37fcfc0a1281e602bcd4c4738 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-02-27T19:32:29.210 INFO:scrape:1 jobs: ['5911814'] 2021-02-27T19:32:29.210 INFO:scrape:suites: ['objectstore/bluestore-stupid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2021-02-27T19:32:29.211 INFO:scrape: 2021-02-27T19:32:29.211 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/ failed: 1 dead: 4 running: 0 waiting: 0 queued: 0 passed: 10 Fail ================================================================= [5911814] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:42:24 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911814/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911814/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba59b5d9c709448e802478f3f6a437bd Command failed (workunit test rados/test.sh) on gibba026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3a09e186830765c37fcfc0a1281e602bcd4c4738 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' Dead ================================================================= [5911808] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911808/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911808/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [5911811] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911811/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911811/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [5911815] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/ubuntu_latest tasks/radosbench thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911815/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911815/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [5911818] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911818/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911818/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [5911804] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911804/ [5911805] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911805/ [5911806] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 00:41:23 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911806/ [5911807] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 01:01:28 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911807/ [5911809] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911809/ [5911810] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:34:02 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911810/ [5911812] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:26:56 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911812/ [5911813] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:08:53 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911813/ [5911816] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/readwrite thrashosds-health whitelist_health} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911816/ [5911817] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:25:18 info: http://pulpito.ceph.com/teuthology-2021-02-24_11:15:04-powercycle-master-distro-basic-gibba/5911817/