2020-09-04T12:13:44.963 INFO:root:teuthology version: 1.0.0-f1fe128 2020-09-04T12:13:44.965 INFO:teuthology.results:subset: '22/9999' 2020-09-04T12:13:44.965 INFO:teuthology.results:seed: '9950' 2020-09-04T12:51:55.006 INFO:root:teuthology version: 1.0.0-f1fe128 2020-09-04T12:51:55.047 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-09-04T14:40:57.563 INFO:teuthology.results:Tests finished! gathering results... 2020-09-04T14:40:59.262 INFO:scrape:Found 15 jobs 2020-09-04T14:40:59.443 INFO:scrape:Found 2 distinct failure reasons 2020-09-04T14:40:59.444 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi006 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03a9754855df491375d5dae1406c4edd122c95ee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2020-09-04T14:40:59.445 INFO:scrape:1 jobs: ['5394978'] 2020-09-04T14:40:59.446 INFO:scrape:suites: ['objectstore/bluestore-stupid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/ubuntu_latest', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2020-09-04T14:40:59.446 INFO:scrape: 2020-09-04T14:40:59.447 INFO:scrape:Failure: Command failed on smithi185 with status 6: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0" 2020-09-04T14:40:59.447 INFO:scrape:1 jobs: ['5394979'] 2020-09-04T14:40:59.448 INFO:scrape:suites: ['objectstore/filestore-xfs', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/radosbench', 'thrashosds-health', 'whitelist_health}'] 2020-09-04T14:40:59.448 INFO:scrape: 2020-09-04T14:40:59.450 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 13 Fail ================================================================= [5394978] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394978/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394978/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=b6e6364fde8841d7a75d063bbf0f84f5 Command failed (workunit test rados/test.sh) on smithi006 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03a9754855df491375d5dae1406c4edd122c95ee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5394979] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/radosbench thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:06:00 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394979/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394979/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=9ebd127907174a4f8ca2e16fb95ed5c7 Command failed on smithi185 with status 6: "sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0" Pass ================================================================= [5394977] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394977/ [5394980] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/readwrite thrashosds-health whitelist_health} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394980/ [5394981] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:23:02 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394981/ [5394982] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394982/ [5394983] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:19:24 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394983/ [5394984] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 00:58:53 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394984/ [5394985] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:44:17 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394985/ [5394986] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:39:01 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394986/ [5394987] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394987/ [5394988] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394988/ [5394989] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394989/ [5394990] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394990/ [5394991] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2020-08-31_11:15:03-powercycle-master-distro-basic-smithi/5394991/