2020-05-02T23:24:09.407 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-02T23:24:09.409 INFO:teuthology.results:subset: '1234/9999' 2020-05-02T23:24:09.410 INFO:teuthology.results:seed: '2477' 2020-05-02T23:24:26.857 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-02T23:24:26.859 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-03T01:13:29.151 INFO:teuthology.results:Tests finished! gathering results... 2020-05-03T01:13:29.202 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [5016490] rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/5016490/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/5016490/ "2020-05-02 23:37:34.151746 osd.1 (osd.1) 1 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running" in cluster log [5016491] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml msgr/simple.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} ----------------------------------------------------------------- time: 01:03:24 info: http://pulpito.ceph.com/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/5016491/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/5016491/ 'retry' [5016492] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/mimic.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-nautilus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:26:59 info: http://pulpito.ceph.com/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/5016492/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-02_16:00:24-rados-nautilus-distro-basic-smithi/5016492/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3dcd64143a744e67ba93be3bea67c13e 'retry' 2020-05-03T01:13:29.317 INFO:teuthology.results:starting coverage generation 2020-05-03T01:13:29.325 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'