2020-08-31T06:37:51.381 INFO:root:teuthology version: 1.0.0-018d708 2020-08-31T06:37:51.383 INFO:teuthology.results:subset: '20/9999' 2020-08-31T06:37:51.383 INFO:teuthology.results:seed: '8157' 2020-08-31T09:10:31.902 INFO:root:teuthology version: 1.0.0-018d708 2020-08-31T09:10:31.956 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-08-31T10:35:34.048 INFO:teuthology.results:Tests finished! gathering results... 2020-08-31T10:35:35.776 INFO:scrape:Found 15 jobs 2020-08-31T10:35:36.637 INFO:scrape:Found 2 distinct failure reasons 2020-08-31T10:35:36.637 INFO:scrape:Crash: Command failed (workunit test fs/misc/dirfrag.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc45de0af6fa6c0ebad640656c77e6f2329b8441 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh' 2020-08-31T10:35:36.638 INFO:scrape:ceph version 16.0.0-4848-gbc45de0af6 (bc45de0af6fa6c0ebad640656c77e6f2329b8441) pacific (dev) 1: (()+0x128a0) [0x7fe5344b38a0] 2: (gsignal()+0xc7) [0x7fe5335abf47] 3: (abort()+0x141) [0x7fe5335ad8b1] 4: (()+0x3042a) [0x7fe53359d42a] 5: (()+0x304a2) [0x7fe53359d4a2] 6: (CDir::_omap_commit(int)+0x15e4) [0x55804726d0f4] 7: (CDir::_commit(unsigned long, int)+0x285) [0x55804726d485] 8: (CDir::_committed(int, unsigned long)+0xe2d) [0x55804726eebd] 9: (MDSContext::complete(int)+0x52) [0x55804730c052] 10: (MDSIOContextBase::complete(int)+0x233) [0x55804730c503] 11: (Finisher::finisher_thread_entry()+0x195) [0x7fe534bf1e55] 12: (()+0x76db) [0x7fe5344a86db] 13: (clone()+0x3f) [0x7fe53368ea3f] 2020-08-31T10:35:36.638 INFO:scrape:1 jobs: ['5388127'] 2020-08-31T10:35:36.639 INFO:scrape:suites: ['objectstore/bluestore-comp-zstd', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/ubuntu_latest', 'tasks/cfuse_workunit_misc', 'thrashosds-health', 'whitelist_health}'] 2020-08-31T10:35:36.639 INFO:scrape: 2020-08-31T10:35:36.640 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi136 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc45de0af6fa6c0ebad640656c77e6f2329b8441 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2020-08-31T10:35:36.640 INFO:scrape:1 jobs: ['5388113'] 2020-08-31T10:35:36.640 INFO:scrape:suites: ['objectstore/bluestore-low-osd-mem-target', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2020-08-31T10:35:36.641 INFO:scrape: 2020-08-31T10:35:36.642 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 13 Fail ================================================================= [5388113] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:24:09 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388113/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388113/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=506d9b3f9e41424790e3394ab78e12e0 Command failed (workunit test rados/test.sh) on smithi136 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc45de0af6fa6c0ebad640656c77e6f2329b8441 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5388127] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:25:08 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388127/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388127/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=322072308ac04ba595badc6094135918 Command failed (workunit test fs/misc/dirfrag.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc45de0af6fa6c0ebad640656c77e6f2329b8441 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh' Pass ================================================================= [5388107] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388107/ [5388109] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388109/ [5388111] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:07:06 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388111/ [5388115] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/radosbench thrashosds-health whitelist_health} time: 02:57:08 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388115/ [5388117] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/readwrite thrashosds-health whitelist_health} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388117/ [5388119] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388119/ [5388121] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:23:57 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388121/ [5388123] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388123/ [5388125] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 01:13:01 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388125/ [5388129] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:35:10 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388129/ [5388131] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388131/ [5388133] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388133/ [5388135] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-08-29_11:15:03-powercycle-master-distro-basic-smithi/5388135/