2020-05-17T19:05:23.837 INFO:root:teuthology version: 1.0.0-437df57
2020-05-17T19:05:23.847 INFO:teuthology.results:seed: '9219'
2020-05-17T19:56:25.451 INFO:root:teuthology version: 1.0.0-437df57
2020-05-17T19:56:25.463 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-05-17T23:22:29.526 INFO:teuthology.results:Tests finished! gathering results...
2020-05-17T23:22:29.656 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/
failed:  11
dead:    0
running: 0
waiting: 0
queued:  0
passed:  56


Fail
=================================================================
[5051059]  krbd/singleton/{conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml}
-----------------------------------------------------------------
time:   02:27:00
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051059/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051059/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1b485e1514e1415f8f8e085467e539c0

    Command failed on smithi115 with status 4: "/usr/bin/sudo
    TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage /bin/bash
    /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s
    /dev/rbd1 -x /tmp/excludeA9LCkQ -r -- '-g auto -g blockdev -x clone'"

[5051068]  krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:38:43
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051068/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051068/

    "2020-05-17 19:28:19.873309 mon.a mon.0 172.21.15.41:6789/0 120 : cluster
    [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster
    log

[5051085]  krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:19:22
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051085/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051085/

    "2020-05-17 19:51:38.793164 mon.a mon.0 172.21.15.62:6789/0 109 : cluster
    [WRN] Health check failed: 3 slow ops, oldest one blocked for 30 sec, osd.7
    has slow ops (SLOW_OPS)" in cluster log

[5051090]  krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml}
-----------------------------------------------------------------
time:   00:56:22
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051090/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051090/

    "2020-05-17 19:57:37.921537 mon.b mon.0 172.21.15.55:6789/0 115 : cluster
    [WRN] Health check failed: 17 slow ops, oldest one blocked for 32 sec,
    osd.2 has slow ops (SLOW_OPS)" in cluster log

[5051091]  krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml}
-----------------------------------------------------------------
time:   00:27:17
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051091/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051091/

    "2020-05-17 19:54:53.787960 mon.b mon.0 172.21.15.64:6789/0 96 : cluster
    [WRN] Health check failed: 368 slow ops, oldest one blocked for 31 sec,
    osd.6 has slow ops (SLOW_OPS)" in cluster log

[5051093]  krbd/singleton/{conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml}
-----------------------------------------------------------------
time:   02:46:57
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051093/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051093/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=8ded9fac5c7d4ee69054549fc3a25577

    Command failed on smithi130 with status 3: "/usr/bin/sudo
    TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage /bin/bash
    /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s
    /dev/rbd1 -x /tmp/excludevQUYox -r -- '-g auto -g blockdev -x clone'"

[5051100]  krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml}
-----------------------------------------------------------------
time:   00:38:41
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051100/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051100/

    "2020-05-17 20:22:34.793291 mon.b mon.0 172.21.15.72:6789/0 137 : cluster
    [WRN] Health check failed: 25 slow ops, oldest one blocked for 31 sec,
    osd.5 has slow ops (SLOW_OPS)" in cluster log

[5051101]  krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
-----------------------------------------------------------------
time:   00:46:26
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051101/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051101/

    "2020-05-17 19:55:52.096025 mon.b mon.1 172.21.15.199:6789/0 19 : cluster
    [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster
    log

[5051103]  krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:39:33
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051103/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051103/

    "2020-05-17 20:05:49.620449 mon.b mon.0 172.21.15.53:6789/0 105 : cluster
    [WRN] Health check failed: 36 slow ops, oldest one blocked for 30 sec,
    daemons [osd.0,osd.6,osd.7] have slow ops. (SLOW_OPS)" in cluster log

[5051118]  krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:19:25
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051118/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051118/

    "2020-05-17 20:19:35.463020 mon.a mon.0 172.21.15.60:6789/0 176 : cluster
    [WRN] Health check failed: 106 slow ops, oldest one blocked for 33 sec,
    daemons [osd.0,osd.5,osd.6,osd.7] have slow ops. (SLOW_OPS)" in cluster log

[5051122]  krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml}
-----------------------------------------------------------------
time:   00:55:35
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051122/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051122/

    "2020-05-17 20:16:34.517931 mon.a mon.0 172.21.15.58:6789/0 151 : cluster
    [WRN] Health check failed: 155 slow ops, oldest one blocked for 33 sec,
    daemons [osd.1,osd.5,osd.6,osd.7] have slow ops. (SLOW_OPS)" in cluster log



Pass
=================================================================
[5051056] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml}
time:   00:09:08
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051056/

[5051057] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml}
time:   00:28:30
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051057/

[5051058] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml}
time:   00:18:45
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051058/

[5051060] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
time:   00:41:57
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051060/

[5051061] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml}
time:   00:09:51
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051061/

[5051062] krbd/wac/sysfs/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml}
time:   00:09:04
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051062/

[5051063] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml}
time:   00:12:15
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051063/

[5051064] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml}
time:   00:15:47
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051064/

[5051065] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml}
time:   00:10:55
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051065/

[5051066] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml}
time:   00:13:50
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051066/

[5051067] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml}
time:   00:41:42
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051067/

[5051069] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml}
time:   00:22:53
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051069/

[5051070] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml}
time:   00:53:05
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051070/

[5051071] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml}
time:   00:15:56
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051071/

[5051072] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml}
time:   00:09:40
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051072/

[5051073] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml}
time:   00:15:30
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051073/

[5051074] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml}
time:   00:10:31
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051074/

[5051075] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml}
time:   00:10:38
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051075/

[5051076] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
time:   00:43:52
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051076/

[5051077] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml}
time:   00:10:49
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051077/

[5051078] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml}
time:   00:10:26
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051078/

[5051079] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml}
time:   00:10:25
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051079/

[5051080] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml}
time:   00:16:40
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051080/

[5051081] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml}
time:   00:09:55
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051081/

[5051082] krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml}
time:   00:17:03
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051082/

[5051083] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kfsx.yaml}
time:   00:13:20
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051083/

[5051084] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
time:   00:49:01
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051084/

[5051086] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml}
time:   00:10:12
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051086/

[5051087] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml}
time:   00:09:10
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051087/

[5051088] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml}
time:   00:15:19
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051088/

[5051089] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml}
time:   00:09:48
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051089/

[5051092] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml}
time:   00:42:08
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051092/

[5051094] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
time:   00:49:03
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051094/

[5051095] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml}
time:   00:11:06
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051095/

[5051096] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml}
time:   00:15:26
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051096/

[5051097] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml}
time:   00:13:42
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051097/

[5051098] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml}
time:   00:09:44
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051098/

[5051099] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml}
time:   00:13:16
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051099/

[5051102] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml}
time:   00:28:33
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051102/

[5051104] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml}
time:   00:10:05
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051104/

[5051105] krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml}
time:   00:17:37
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051105/

[5051106] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml}
time:   00:15:51
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051106/

[5051107] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml}
time:   00:15:30
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051107/

[5051108] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml}
time:   00:10:29
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051108/

[5051109] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml}
time:   00:10:13
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051109/

[5051110] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml}
time:   00:48:27
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051110/

[5051111] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml}
time:   00:10:25
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051111/

[5051112] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml}
time:   00:10:46
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051112/

[5051113] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml}
time:   00:09:32
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051113/

[5051114] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml}
time:   00:10:15
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051114/

[5051115] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml}
time:   00:17:31
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051115/

[5051116] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kfsx.yaml}
time:   00:15:25
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051116/

[5051117] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml}
time:   00:47:32
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051117/

[5051119] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml}
time:   00:10:02
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051119/

[5051120] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml}
time:   00:15:03
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051120/

[5051121] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml}
time:   00:10:25
info:   http://pulpito.ceph.com/teuthology-2020-05-13_05:15:01-krbd-mimic-testing-basic-smithi/5051121/
2020-05-17T23:22:29.847 INFO:teuthology.results:starting coverage generation
2020-05-17T23:22:29.852 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'