2021-03-03T11:17:00.447 INFO:root:teuthology version: 1.1.0-3082387b 2021-03-03T11:17:00.450 INFO:teuthology.results:subset: '62/100000' 2021-03-03T11:17:00.450 INFO:teuthology.results:seed: '1209' 2021-03-03T12:26:28.175 INFO:root:teuthology version: 1.1.0-3082387b 2021-03-03T12:26:28.225 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-03-03T23:39:16.130 INFO:teuthology.results:Tests finished! gathering results... 2021-03-03T23:39:42.803 INFO:scrape:Found 15 jobs 2021-03-03T23:39:42.817 INFO:scrape:Found 3 distinct failure reasons 2021-03-03T23:39:42.818 INFO:scrape:Dead: b'2021-03-03T23:36:42.222 DEBUG:teuthology.exit:Finished running handlers' 2021-03-03T23:39:42.819 INFO:scrape:1 jobs: ['5929463'] 2021-03-03T23:39:42.819 INFO:scrape:suites: ['objectstore/bluestore-stupid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/radosbench', 'thrashosds-health', 'whitelist_health}'] 2021-03-03T23:39:42.820 INFO:scrape: 2021-03-03T23:39:42.820 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on gibba009 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d4292afebffe28648a2d27cbf1597b82a77c8593 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-03-03T23:39:42.820 INFO:scrape:1 jobs: ['5929462'] 2021-03-03T23:39:42.821 INFO:scrape:suites: ['objectstore/bluestore-low-osd-mem-target', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/ubuntu_latest', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2021-03-03T23:39:42.821 INFO:scrape: 2021-03-03T23:39:42.822 INFO:scrape:Failure: Command failed on gibba013 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp' 2021-03-03T23:39:42.822 INFO:scrape:1 jobs: ['5929469'] 2021-03-03T23:39:42.823 INFO:scrape:suites: ['objectstore/bluestore-comp-zstd', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_misc', 'thrashosds-health', 'whitelist_health}'] 2021-03-03T23:39:42.823 INFO:scrape: 2021-03-03T23:39:42.825 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/ failed: 2 dead: 1 running: 0 waiting: 0 queued: 0 passed: 12 Fail ================================================================= [5929462] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:44:33 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929462/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929462/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fadf734aa9434e008586264307e442b9 Command failed (workunit test rados/test.sh) on gibba009 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d4292afebffe28648a2d27cbf1597b82a77c8593 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5929469] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:59:09 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929469/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929469/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d139be0408ff4d72ae2ef68652e4b2d1 Command failed on gibba013 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp' Dead ================================================================= [5929463] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/radosbench thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929463/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929463/ hit max job timeout Pass ================================================================= [5929459] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:33:15 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929459/ [5929460] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:30:56 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929460/ [5929461] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929461/ [5929464] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/readwrite thrashosds-health whitelist_health} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929464/ [5929465] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:24:04 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929465/ [5929466] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:25:42 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929466/ [5929467] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:19:20 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929467/ [5929468] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 01:00:50 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929468/ [5929470] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 01:02:03 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929470/ [5929471] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:29:49 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929471/ [5929472] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:41:08 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929472/ [5929473] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:30:56 info: http://pulpito.ceph.com/teuthology-2021-03-03_11:15:04-powercycle-master-distro-basic-gibba/5929473/