2020-05-11T10:45:17.835 INFO:root:teuthology version: 1.0.0-28c1ab5
2020-05-11T10:45:17.837 INFO:teuthology.results:subset: '26/2999'
2020-05-11T10:45:17.837 INFO:teuthology.results:seed: '9157'
2020-05-11T12:47:19.839 INFO:root:teuthology version: 1.0.0-28c1ab5
2020-05-11T12:47:19.861 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-05-11T19:44:27.684 INFO:teuthology.results:Tests finished! gathering results...
2020-05-11T19:44:27.812 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/
failed:  16
dead:    4
running: 0
waiting: 0
queued:  0
passed:  23


Fail
=================================================================
[5043019]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml}
-----------------------------------------------------------------
time:   00:13:41
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043019/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043019/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=74a5518e04f0464ab697db4d08fd7742

    Command failed on smithi033 with status 1: "sudo sh -c 'cat >
    /home/ubuntu/cephtest/valgrind.supp'"

[5043025]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml}
-----------------------------------------------------------------
time:   00:24:09
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043025/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043025/

    timed out

[5043027]  kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml}
-----------------------------------------------------------------
time:   00:02:09
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043027/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043027/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=f1de308400ef48f68c87e348a7c08225

    {'Failure object was': {'smithi041.front.sepia.ceph.com': {"u'msg'": "u'yum
    lockfile is held by another process'", 'changed': False, "u'invocation'":
    {"u'module_args'": {"u'list'": 'None', "u'disable_plugin'": [],
    "u'install_weak_deps'": True, "u'name'":
    ["u'http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-
    latest.noarch.rpm'"], "u'releasever'": 'None', "u'security'": False,
    "u'conf_file'": 'None', "u'autoremove'": False, "u'update_cache'": False,
    "u'disablerepo'": [], "u'skip_broken'": False, "u'disable_gpg_check'":
    False, "u'lock_timeout'": 0, "u'download_only'": False, "u'enablerepo'":
    [], "u'disable_excludes'": 'None', "u'download_dir'": 'None', "u'state'":
    "u'present'", "u'install_repoquery'": True, "u'allow_downgrade'": False,
    "u'validate_certs'": False, "u'update_only'": False, "u'exclude'": [],
    "u'bugfix'": False, "u'enable_plugin'": [], "u'use_backend'": "u'auto'",
    "u'installroot'": "u'/'"}}, '_ansible_no_log': False}}, 'Traceback (most
    recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-
    ansible_master/callback_plugins/failure_log.py", line 44, in log_failure
    log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com
    _git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data],
    stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com
    _git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data)
    File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/loca
    l/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent
    node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_g
    it_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 58, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 227, in represent_dict return
    self.represent_mapping(u\'tag:yaml.org,2002:map\', data) File "/home/teuthw
    orker/src/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/si
    te-packages/yaml/representer.py", line 125, in represent_mapping node_value
    = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_
    git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 58, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 227, in represent_dict return
    self.represent_mapping(u\'tag:yaml.org,2002:map\', data) File "/home/teuthw
    orker/src/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/si
    te-packages/yaml/representer.py", line 125, in represent_mapping node_value
    = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_
    git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 58, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 227, in represent_dict return
    self.represent_mapping(u\'tag:yaml.org,2002:map\', data) File "/home/teuthw
    orker/src/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/si
    te-packages/yaml/representer.py", line 125, in represent_mapping node_value
    = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_
    git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 58, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 227, in represent_dict return
    self.represent_mapping(u\'tag:yaml.org,2002:map\', data) File "/home/teuthw
    orker/src/git.ceph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/si
    te-packages/yaml/representer.py", line 125, in represent_mapping node_value
    = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_
    git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 68, in represent_data node =
    self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce
    ph.com_git_teuthology_py2/virtualenv/local/lib/python2.7/site-
    packages/yaml/representer.py", line 251, in represent_undefined raise
    RepresenterError("cannot represent an object", data)', 'RepresenterError':
    "('cannot represent an object', u'/')"}

[5043031]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043031/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043031/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=fb8d877ced2b4628a00185f99f63f529

    [Errno None] Unable to connect to port 22 on 172.21.15.104

[5043033]  kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml}
-----------------------------------------------------------------
time:   00:06:54
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043033/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043033/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=717adc6dde85438899b59d1def7bc61e

    {'smithi041.front.sepia.ceph.com': {'msg': 'Data could not be sent to
    remote host "smithi041.front.sepia.ceph.com". Make sure this host can be
    reached over ssh: Warning: Permanently added
    \'smithi041.front.sepia.ceph.com,172.21.15.41\' (ECDSA) to the list of
    known hosts.\r\nubuntu@smithi041.front.sepia.ceph.com: Permission denied
    (publickey,password,keyboard-interactive).\r\n', 'unreachable': True,
    'changed': False}}

[5043034]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043034/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043034/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5beae95f9b8c4ab6b142070c509efe36

    machine smithi099.front.sepia.ceph.com is locked by
    scheduled_sidharthanup@teuthology, not scheduled_teuthology@teuthology

[5043040]  kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043040/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043040/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c1144096df8c4e4ab3eaa35dbba2dce6

    machine smithi079.front.sepia.ceph.com is locked by
    scheduled_kchai@teuthology, not scheduled_teuthology@teuthology

[5043044]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043044/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043044/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9b356f169a434642a5c0df154e4cfd4a

    machine smithi074.front.sepia.ceph.com is locked by
    scheduled_varsha@teuthology, not scheduled_teuthology@teuthology

[5043045]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043045/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043045/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=14a43bbac6734cacbb28b05a5d72dfa9

    machine smithi099.front.sepia.ceph.com is locked by
    scheduled_sidharthanup@teuthology, not scheduled_teuthology@teuthology

[5043046]  kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043046/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043046/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=133c1828d9a44f589922301671b66e58

    machine smithi064.front.sepia.ceph.com is locked by
    scheduled_kchai@teuthology, not scheduled_teuthology@teuthology

[5043047]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043047/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043047/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=595300b435e34fbea13e20cd54be18d7

    machine smithi158.front.sepia.ceph.com is locked by
    scheduled_sidharthanup@teuthology, not scheduled_teuthology@teuthology

[5043053]  kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{rhel_latest.yaml}} ms-die-on-skipped.yaml} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043053/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043053/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=659a1558afbf4a4cbc603c488e6e09ca

    Command failed on smithi158 with status 1: 'sudo chcon
    system_u:object_r:var_log_t:s0
    /home/ubuntu/cephtest/archive/syslog/kern.log'

[5043054]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043054/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043054/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=29a43794da0848be976f743bbf1f84b2

    Could not reconnect to ubuntu@smithi158.front.sepia.ceph.com

[5043056]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043056/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043056/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=e591deeb618b41a7899e8ea0eec37115

    machine smithi099.front.sepia.ceph.com is locked by
    scheduled_sidharthanup@teuthology, not scheduled_teuthology@teuthology

[5043057]  kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043057/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043057/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=ae293df201714b1887fecce174c70356

    machine smithi099.front.sepia.ceph.com is locked by
    scheduled_sidharthanup@teuthology, not scheduled_teuthology@teuthology

[5043060]  kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml}
-----------------------------------------------------------------
time:   00:06:34
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043060/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043060/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=31354a0b42f24173b56bfe1018f69ce8

    {'smithi158.front.sepia.ceph.com': {'msg': 'Data could not be sent to
    remote host "smithi158.front.sepia.ceph.com". Make sure this host can be
    reached over ssh: ssh: connect to host smithi158.front.sepia.ceph.com port
    22: No route to host\r\n', 'unreachable': True, 'changed': False}}



Dead
=================================================================
[5043042]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043042/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043042/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=522b9ec88a3c4108bc778f3218670522

    'ssh_keyscan smithi198.front.sepia.ceph.com' reached maximum tries (5)
    after waiting for 5 seconds

[5043048]  kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043048/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043048/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2b91b8977acd4d54a74e8119d6fe601f

    'ssh_keyscan smithi161.front.sepia.ceph.com' reached maximum tries (5)
    after waiting for 5 seconds

[5043052]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043052/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043052/

[5043061]  kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043061/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043061/



Pass
=================================================================
[5043020] kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml}
time:   00:54:52
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043020/

[5043021] kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml}
time:   00:20:27
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043021/

[5043022] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_16.04.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml}
time:   00:27:21
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043022/

[5043023] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml}
time:   00:38:50
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043023/

[5043024] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml}
time:   00:20:27
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043024/

[5043026] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml}
time:   00:19:19
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043026/

[5043028] kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml}
time:   00:29:44
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043028/

[5043029] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml}
time:   00:17:44
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043029/

[5043030] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml}
time:   00:22:08
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043030/

[5043032] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml}
time:   00:15:45
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043032/

[5043035] kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_16.04.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml}
time:   00:14:04
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043035/

[5043036] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_16.04.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml}
time:   00:19:48
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043036/

[5043037] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml}
time:   00:20:24
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043037/

[5043038] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml}
time:   00:15:39
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043038/

[5043039] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml}
time:   00:32:23
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043039/

[5043041] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml}
time:   00:12:51
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043041/

[5043043] kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml}
time:   00:54:47
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043043/

[5043049] kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml}
time:   00:24:59
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043049/

[5043050] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml}
time:   00:20:54
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043050/

[5043051] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml}
time:   00:33:05
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043051/

[5043055] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_latest.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml}
time:   00:29:53
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043055/

[5043058] kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml}
time:   00:25:09
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043058/

[5043059] kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_16.04.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml}
time:   00:43:25
info:   http://pulpito.ceph.com/teuthology-2020-05-10_13:25:02-kcephfs-nautilus-testing-basic-smithi/5043059/
2020-05-11T19:44:27.930 INFO:teuthology.results:starting coverage generation
2020-05-11T19:44:27.935 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'