2020-05-19T00:23:31.109 INFO:root:teuthology version: 1.0.0-f81437e 2020-05-19T00:23:31.111 INFO:teuthology.results:seed: '1665' 2020-05-19T11:01:40.742 INFO:root:teuthology version: 1.0.0-f81437e 2020-05-19T11:01:40.801 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-19T16:07:48.359 INFO:teuthology.results:Tests finished! gathering results... 2020-05-19T16:07:49.235 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 90 Fail ================================================================= [5064224] krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 03:17:18 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064224/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064224/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=86aab504b80a42e28325af02ddce1f3c Command failed on smithi123 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude2k35_fua -r -- '-g auto -g blockdev -x clone'" [5064237] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 01:05:25 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064237/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064237/ "2020-05-19T01:00:16.122973+0000 mon.b (mon.1) 81 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log [5064273] krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 04:01:34 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064273/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064273/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b5ee6c34d3c5451eaeb8cff75918f9dc Command failed on smithi135 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeweec08a9 -r -- '-g auto -g blockdev -x clone'" [5064284] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} ----------------------------------------------------------------- time: 00:50:17 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064284/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064284/ "2020-05-19T10:45:33.753579+0000 mon.a (mon.1) 34 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log [5064298] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} ----------------------------------------------------------------- time: 04:40:24 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064298/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064298/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f38cfe55b50342cab5d5a0048d3c1aa0 Command failed (workunit test rbd/concurrent.sh) on smithi190 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8aac5d278525c45468d753c3542a820226019dda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [5064302] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} ----------------------------------------------------------------- time: 00:36:33 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064302/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064302/ "2020-05-19T10:59:01.134707+0000 mon.b (mon.0) 146 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log Pass ================================================================= [5064220] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_deep_flatten.yaml} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064220/ [5064221] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064221/ [5064222] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} time: 00:31:40 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064222/ [5064223] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} time: 00:24:50 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064223/ [5064225] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:50:26 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064225/ [5064226] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064226/ [5064227] krbd/wac/sysfs/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064227/ [5064228] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} time: 00:13:33 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064228/ [5064229] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} time: 00:29:17 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064229/ [5064230] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064230/ [5064231] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064231/ [5064232] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:28:18 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064232/ [5064233] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_huge_osdmap.yaml} time: 00:13:13 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064233/ [5064234] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:42:17 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064234/ [5064235] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_discard.yaml} time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064235/ [5064236] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:26:26 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064236/ [5064238] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:16:19 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064238/ [5064239] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} time: 00:32:21 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064239/ [5064240] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} time: 01:18:46 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064240/ [5064241] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_namespaces.yaml} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064241/ [5064242] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} time: 00:25:31 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064242/ [5064243] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:32:16 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064243/ [5064244] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064244/ [5064245] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064245/ [5064246] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064246/ [5064247] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064247/ [5064248] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:54:25 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064248/ [5064249] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} time: 00:17:40 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064249/ [5064250] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064250/ [5064251] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} time: 00:28:56 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064251/ [5064252] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064252/ [5064253] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:32:08 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064253/ [5064254] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064254/ [5064255] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064255/ [5064256] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064256/ [5064257] krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064257/ [5064258] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064258/ [5064259] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_modprobe.yaml} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064259/ [5064260] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064260/ [5064261] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 01:05:24 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064261/ [5064262] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064262/ [5064263] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064263/ [5064264] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} time: 00:39:05 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064264/ [5064265] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064265/ [5064266] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064266/ [5064267] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:31:21 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064267/ [5064268] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064268/ [5064269] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064269/ [5064270] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:30:19 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064270/ [5064271] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} time: 00:31:30 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064271/ [5064272] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} time: 00:31:35 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064272/ [5064274] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 01:12:39 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064274/ [5064275] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064275/ [5064276] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} time: 00:33:51 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064276/ [5064277] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064277/ [5064278] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064278/ [5064279] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:36:18 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064279/ [5064280] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_huge_osdmap.yaml} time: 00:12:56 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064280/ [5064281] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:41:52 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064281/ [5064282] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064282/ [5064283] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:24:55 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064283/ [5064285] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064285/ [5064286] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} time: 00:34:56 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064286/ [5064287] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} time: 01:03:46 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064287/ [5064288] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_namespaces.yaml} time: 00:16:06 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064288/ [5064289] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064289/ [5064290] krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} time: 00:24:13 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064290/ [5064291] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064291/ [5064292] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064292/ [5064293] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:15:41 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064293/ [5064294] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:17:21 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064294/ [5064295] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064295/ [5064296] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:29:14 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064296/ [5064297] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:58:29 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064297/ [5064299] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064299/ [5064300] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} time: 00:33:40 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064300/ [5064301] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064301/ [5064303] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:21:27 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064303/ [5064304] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064304/ [5064305] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} time: 00:12:00 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064305/ [5064306] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064306/ [5064307] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:25:38 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064307/ [5064308] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:53:28 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064308/ [5064309] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064309/ [5064310] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:11:50 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064310/ [5064311] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/object-map.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} time: 00:31:42 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064311/ [5064312] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064312/ [5064313] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064313/ [5064314] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml features/no-object-map.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:33:12 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064314/ [5064315] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2020-05-18_03:20:02-krbd-master-testing-basic-smithi/5064315/ 2020-05-19T16:07:49.374 INFO:teuthology.results:starting coverage generation 2020-05-19T16:07:49.380 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'