2020-11-17T19:02:16.754 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-17T19:02:16.755 INFO:teuthology.results:subset: '16/100000' 2020-11-17T19:02:16.756 INFO:teuthology.results:seed: '8532' 2020-11-17T19:09:15.640 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-17T19:09:15.667 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-17T22:37:19.334 INFO:teuthology.results:Tests finished! gathering results... 2020-11-17T22:37:20.666 INFO:scrape:Found 15 jobs 2020-11-17T22:37:21.097 INFO:scrape:Found 2 distinct failure reasons 2020-11-17T22:37:21.098 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi116 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ff227345eb28743a41427f6d4cbc46f70082dda4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2020-11-17T22:37:21.098 INFO:scrape:1 jobs: ['5633520'] 2020-11-17T22:37:21.099 INFO:scrape:suites: ['objectstore/bluestore-comp-zstd', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2020-11-17T22:37:21.099 INFO:scrape: 2020-11-17T22:37:21.100 INFO:scrape:Failure: Command failed on smithi137 with status 6: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0" 2020-11-17T22:37:21.100 INFO:scrape:1 jobs: ['5633527'] 2020-11-17T22:37:21.101 INFO:scrape:suites: ['objectstore/bluestore-comp-snappy', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_misc', 'thrashosds-health', 'whitelist_health}'] 2020-11-17T22:37:21.101 INFO:scrape: 2020-11-17T22:37:21.103 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 13 Fail ================================================================= [5633520] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:27:10 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633520/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633520/ sentry: https://sentry.ceph.com/organizations/ceph/?query=27edaf6a7c7348c396184e639fb5aced Command failed (workunit test rados/test.sh) on smithi116 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ff227345eb28743a41427f6d4cbc46f70082dda4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5633527] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:05:57 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633527/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633527/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85c6e69038f44dda85b27d9dfbe3054e Command failed on smithi137 with status 6: "sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0" Pass ================================================================= [5633513] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:50:23 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633513/ [5633514] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:39:42 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633514/ [5633515] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:19:45 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633515/ [5633516] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633516/ [5633517] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633517/ [5633518] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633518/ [5633519] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633519/ [5633521] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/radosbench thrashosds-health whitelist_health} time: 03:24:08 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633521/ [5633522] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/readwrite thrashosds-health whitelist_health} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633522/ [5633523] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:24:10 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633523/ [5633524] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633524/ [5633525] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:23:02 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633525/ [5633526] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 01:05:28 info: http://pulpito.ceph.com/teuthology-2020-11-17_11:15:03-powercycle-master-distro-basic-smithi/5633526/