2021-01-09T11:40:29.005 INFO:root:teuthology version: 1.0.0-77817aa4 2021-01-09T11:40:29.006 INFO:teuthology.results:subset: '13/100000' 2021-01-09T11:40:29.007 INFO:teuthology.results:seed: '9932' 2021-01-09T11:51:18.054 INFO:root:teuthology version: 1.0.0-77817aa4 2021-01-09T11:51:18.077 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-09T13:40:19.999 INFO:teuthology.results:Tests finished! gathering results... 2021-01-09T13:40:21.445 INFO:scrape:Found 15 jobs 2021-01-09T13:40:21.496 INFO:scrape:Found 2 distinct failure reasons 2021-01-09T13:40:21.497 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi156 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b5fd5b505f62f47aa10e73a242520a628f2354b5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-01-09T13:40:21.497 INFO:scrape:1 jobs: ['5770085'] 2021-01-09T13:40:21.498 INFO:scrape:suites: ['objectstore/bluestore-stupid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2021-01-09T13:40:21.499 INFO:scrape: 2021-01-09T13:40:21.499 INFO:scrape:Failure: reached maximum tries (60) after waiting for 900 seconds 2021-01-09T13:40:21.500 INFO:scrape:1 jobs: ['5770075'] 2021-01-09T13:40:21.500 INFO:scrape: 2021-01-09T13:40:21.501 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/ failed: 1 dead: 1 running: 0 waiting: 0 queued: 0 passed: 13 Fail ================================================================= [5770085] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:39:28 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770085/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770085/ sentry: https://sentry.ceph.com/organizations/ceph/?query=937bfb51b38144a9bbb5a741e1407263 Command failed (workunit test rados/test.sh) on smithi156 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b5fd5b505f62f47aa10e73a242520a628f2354b5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' Dead ================================================================= [5770075] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770075/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770075/ sentry: https://sentry.ceph.com/organizations/ceph/?query=34beacfe87d444dabe8ba74f243b9024 reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [5770076] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770076/ [5770077] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 00:49:43 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770077/ [5770078] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:57:22 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770078/ [5770079] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:50:33 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770079/ [5770080] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:22:36 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770080/ [5770081] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:36:16 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770081/ [5770082] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:25:24 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770082/ [5770083] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:22:24 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770083/ [5770084] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770084/ [5770086] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/radosbench thrashosds-health whitelist_health} time: 01:44:05 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770086/ [5770087] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/readwrite thrashosds-health whitelist_health} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770087/ [5770088] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:27:21 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770088/ [5770089] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:23:06 info: http://pulpito.ceph.com/teuthology-2021-01-09_11:15:03-powercycle-master-distro-basic-smithi/5770089/