2020-04-29T02:41:37.749 INFO:root:teuthology version: 1.0.0-6cf40593 2020-04-29T02:41:37.751 INFO:teuthology.results:seed: '507' 2020-04-29T09:42:54.892 INFO:root:teuthology version: 1.0.0-6cf40593 2020-04-29T09:42:54.939 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-04-29T12:20:57.944 INFO:teuthology.results:Tests finished! gathering results... 2020-04-29T12:20:58.072 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 74 Fail ================================================================= [4990354] krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 03:05:27 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990354/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990354/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c608d7ea3a674101a47599168ffdd6d0 Command failed on smithi187 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludegn6gkL -r -- '-g auto -g blockdev -x clone'" [4990394] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 00:48:45 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990394/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990394/ "2020-04-29 06:22:03.600010 mon.a (mon.1) 32 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log [4990439] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} ----------------------------------------------------------------- time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990439/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990439/ "2020-04-29 07:16:48.368744 mon.a (mon.0) 16 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log [4990467] krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} ----------------------------------------------------------------- time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990467/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990467/ "2020-04-29 08:18:37.898362 mon.b (mon.0) 122 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 32 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log [4990479] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990479/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990479/ "2020-04-29 08:23:28.509814 mon.a (mon.0) 136 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log [4990500] krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 03:40:09 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990500/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990500/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=22880aef932643ac95334bed3a4919a0 Command failed on smithi093 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludegT5biA -r -- '-g auto -g blockdev -x clone'" [4990518] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} ----------------------------------------------------------------- time: 01:08:11 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990518/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990518/ "2020-04-29 08:51:23.340729 mon.a (mon.0) 110 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log Pass ================================================================= [4990338] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_deep_flatten.yaml} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990338/ [4990342] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:31:08 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990342/ [4990346] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} time: 00:36:19 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990346/ [4990350] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990350/ [4990358] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 01:08:14 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990358/ [4990362] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990362/ [4990366] krbd/wac/sysfs/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990366/ [4990370] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990370/ [4990374] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:16:06 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990374/ [4990378] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990378/ [4990382] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} time: 00:34:08 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990382/ [4990386] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990386/ [4990390] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:47:53 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990390/ [4990398] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_discard.yaml} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990398/ [4990402] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_namespaces.yaml} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990402/ [4990406] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:34:28 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990406/ [4990410] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} time: 00:57:07 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990410/ [4990414] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} time: 00:27:33 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990414/ [4990418] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990418/ [4990422] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990422/ [4990427] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:24:39 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990427/ [4990430] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990430/ [4990434] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 01:08:00 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990434/ [4990443] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990443/ [4990448] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990448/ [4990451] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990451/ [4990455] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} time: 00:35:35 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990455/ [4990459] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:19:10 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990459/ [4990463] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990463/ [4990471] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990471/ [4990475] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:54:44 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990475/ [4990482] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990482/ [4990484] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:28:54 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990484/ [4990486] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990486/ [4990488] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990488/ [4990490] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990490/ [4990492] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} time: 00:27:36 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990492/ [4990494] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:29:44 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990494/ [4990496] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} time: 00:37:06 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990496/ [4990498] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} time: 00:25:30 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990498/ [4990502] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:53:38 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990502/ [4990504] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990504/ [4990506] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990506/ [4990508] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990508/ [4990510] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990510/ [4990513] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} time: 00:37:23 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990513/ [4990515] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990515/ [4990516] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:43:10 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990516/ [4990520] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_namespaces.yaml} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990520/ [4990522] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} time: 00:34:10 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990522/ [4990524] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} time: 00:47:16 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990524/ [4990526] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990526/ [4990528] krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} time: 00:19:17 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990528/ [4990531] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} time: 00:25:33 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990531/ [4990533] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990533/ [4990534] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990534/ [4990536] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990536/ [4990538] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:26:52 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990538/ [4990541] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990541/ [4990543] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:53:57 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990543/ [4990545] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990545/ [4990547] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990547/ [4990549] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990549/ [4990551] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} time: 00:36:11 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990551/ [4990553] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:20:13 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990553/ [4990555] krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} time: 00:10:01 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990555/ [4990557] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990557/ [4990559] krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 01:06:45 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990559/ [4990561] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990561/ [4990563] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990563/ [4990565] krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990565/ [4990567] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990567/ [4990569] krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990569/ [4990571] krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} time: 00:24:41 info: http://pulpito.ceph.com/teuthology-2020-04-27_05:15:02-krbd-nautilus-testing-basic-smithi/4990571/ 2020-04-29T12:20:58.196 INFO:teuthology.results:starting coverage generation 2020-04-29T12:20:58.199 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'