2020-05-18T18:48:25.980 INFO:root:teuthology version: 1.0.0-437df57
2020-05-18T18:48:25.982 INFO:teuthology.results:seed: '9490'
2020-05-18T18:54:47.347 INFO:root:teuthology version: 1.0.0-437df57
2020-05-18T18:54:47.350 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-05-18T20:09:48.863 INFO:teuthology.results:Tests finished! gathering results...
2020-05-18T20:09:48.955 INFO:teuthology.results:Sending results to jlayton@redhat.com: Test Run: jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/
failed:  4
dead:    6
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[5067881]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml}
-----------------------------------------------------------------
time:   00:10:55
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067881/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067881/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=032d6172158e4545a59a8610b5456376

    No module named 'cephfs.kernel_mount'

[5067883]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml}
-----------------------------------------------------------------
time:   00:09:53
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067883/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067883/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5a9fa2e6afd64ed5be3d029691dd1d22

    No module named 'cephfs.kernel_mount'

[5067884]  kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml}
-----------------------------------------------------------------
time:   00:11:01
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067884/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067884/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=8045238e66884a4bb560b2aa56572392

    No module named 'cephfs.kernel_mount'

[5067885]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:10:40
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067885/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067885/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=60a9c8491df64cae8f71821644f85851

    No module named 'cephfs.kernel_mount'



Dead
=================================================================
[5067882]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067882/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067882/

[5067886]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067886/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067886/

[5067887]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067887/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067887/

[5067888]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067888/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067888/

[5067889]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067889/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067889/

[5067890]  kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067890/
log:    http://qa-proxy.ceph.com/teuthology/jlayton-2020-05-18_18:45:34-kcephfs-octopus-distro-basic-smithi/5067890/
2020-05-18T20:09:49.173 INFO:teuthology.results:starting coverage generation
2020-05-18T20:09:49.179 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'