2020-04-23T11:48:40.047 INFO:root:teuthology version: 1.0.0-876b8741
2020-04-23T11:48:40.049 INFO:teuthology.results:subset: '2/999'
2020-04-23T11:48:40.049 INFO:teuthology.results:seed: '7839'
2020-04-23T11:58:40.836 INFO:root:teuthology version: 1.0.0-876b8741
2020-04-23T11:58:41.401 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-04-23T13:03:42.513 INFO:teuthology.results:Tests finished! gathering results...
2020-04-23T13:03:42.597 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/
failed:  24
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[4973773]  multimds/basic/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
-----------------------------------------------------------------
time:   00:14:10
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973773/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973773/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=6320326c9eb544719c096975aca09cfa

    cannot use a string pattern on a bytes-like object

[4973774]  multimds/verify/{begin.yaml centos_latest.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:11:19
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973774/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973774/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=72557e4c82604c6da4043ddcd1a81a6a

    cannot use a string pattern on a bytes-like object

[4973775]  multimds/thrash/{0-supported-random-distro$/{centos_8.yaml} begin.yaml ceph-thrash/mds.yaml clusters/3-mds-2-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml}
-----------------------------------------------------------------
time:   00:11:20
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973775/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973775/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=526b97a70c844f958be674ba95d16a7a

    cannot use a string pattern on a bytes-like object

[4973776]  multimds/basic/{0-supported-random-distro$/{centos_8.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/stock/{k-stock.yaml rhel_8.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml}
-----------------------------------------------------------------
time:   00:12:24
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973776/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973776/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9462c6dc3d0749e9b69e310f4d759288

    cannot use a string pattern on a bytes-like object

[4973777]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_norstats.yaml}
-----------------------------------------------------------------
time:   00:10:41
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973777/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973777/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=899797a7824d4a8f9b70bf69c6390857

    cannot use a string pattern on a bytes-like object

[4973778]  multimds/verify/{begin.yaml centos_latest.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{k-testing.yaml mount.yaml ms-die-on-skipped.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:26:41
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973778/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973778/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=f6f1ca2604f94f3d9b3e709ef2116759

    cannot use a string pattern on a bytes-like object

[4973779]  multimds/thrash/{0-supported-random-distro$/{centos_8.yaml} begin.yaml ceph-thrash/mon.yaml clusters/9-mds-3-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{mount.yaml overrides/{distro/stock/{k-stock.yaml rhel_8.yaml} ms-die-on-skipped.yaml}} msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml}
-----------------------------------------------------------------
time:   00:13:43
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973779/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973779/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=06979d4924bc4e049de121a8c6e627f1

    cannot use a string pattern on a bytes-like object

[4973780]  multimds/basic/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/ubuntu_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml}
-----------------------------------------------------------------
time:   00:12:38
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973780/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973780/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5ba0fd3bb6e74a8daa401105e6124287

    cannot use a string pattern on a bytes-like object

[4973781]  multimds/basic/{0-supported-random-distro$/{centos_8.yaml} begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_dbench.yaml}
-----------------------------------------------------------------
time:   00:11:22
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973781/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973781/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=93d974dcf5684a69830af6017f0132a8

    cannot use a string pattern on a bytes-like object

[4973782]  multimds/verify/{begin.yaml centos_latest.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:11:13
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973782/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973782/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9a5153e3c92444b191169b68d94982c8

    cannot use a string pattern on a bytes-like object

[4973783]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml ceph-thrash/mds.yaml clusters/3-mds-2-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} msgr-failures/none.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml}
-----------------------------------------------------------------
time:   00:10:06
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973783/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973783/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=95aad0da2d724d7e97c4906c7a1d128b

    cannot use a string pattern on a bytes-like object

[4973784]  multimds/basic/{0-supported-random-distro$/{centos_8.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/stock/{k-stock.yaml rhel_8.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml}
-----------------------------------------------------------------
time:   00:12:28
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973784/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973784/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=32ca03143eef4149a368961667607abe

    cannot use a string pattern on a bytes-like object

[4973785]  multimds/basic/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsstress.yaml}
-----------------------------------------------------------------
time:   00:10:22
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973785/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973785/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=daa76e346a6a4914811aa897f3c517ae

    cannot use a string pattern on a bytes-like object

[4973786]  multimds/verify/{begin.yaml centos_latest.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{k-testing.yaml mount.yaml ms-die-on-skipped.yaml} objectstore-ec/bluestore-bitmap.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:34:15
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973786/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973786/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=e5aeb2c980d64a648871aac46e25a760

    cannot use a string pattern on a bytes-like object

[4973787]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml ceph-thrash/mon.yaml clusters/9-mds-3-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/ubuntu_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml}
-----------------------------------------------------------------
time:   00:09:53
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973787/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973787/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=769d9608dfbb4173b18e36c880d1e1a8

    cannot use a string pattern on a bytes-like object

[4973788]  multimds/basic/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/ubuntu_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml}
-----------------------------------------------------------------
time:   00:10:17
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973788/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973788/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=ba80e49595f340e39473a55671a64831

    cannot use a string pattern on a bytes-like object

[4973789]  multimds/basic/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_pjd.yaml}
-----------------------------------------------------------------
time:   00:15:17
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973789/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973789/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=da40d1c22e2247489df1c80453baa086

    cannot use a string pattern on a bytes-like object

[4973790]  multimds/verify/{begin.yaml centos_latest.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/lockdep.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973790/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973790/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=79697f11e3de4c83b30ebd15dab1f0e5

    Command failed on smithi025 with status 1: 'sudo yum upgrade -y linux-
    firmware'

[4973791]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest.yaml} begin.yaml ceph-thrash/mds.yaml clusters/3-mds-2-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_fsstress.yaml}
-----------------------------------------------------------------
time:   00:10:12
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973791/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973791/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=45345d6cb1ee40ce95ec9a6aedb82da1

    cannot use a string pattern on a bytes-like object

[4973792]  multimds/basic/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/stock/{k-stock.yaml rhel_8.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_exports.yaml}
-----------------------------------------------------------------
time:   00:12:57
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973792/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973792/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=0cf4c464fcbd40839e2b6c3f4b3d0f5c

    cannot use a string pattern on a bytes-like object

[4973793]  multimds/basic/{0-supported-random-distro$/{centos_8.yaml} begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/centos_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml}
-----------------------------------------------------------------
time:   00:10:00
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973793/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973793/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=08132acd130a4b3eb62262cff8741fa9

    cannot use a string pattern on a bytes-like object

[4973794]  multimds/verify/{begin.yaml centos_latest.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{k-testing.yaml mount.yaml ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml}
-----------------------------------------------------------------
time:   00:33:49
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973794/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973794/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c48c209769cc4dab96f93c6e04af7851

    cannot use a string pattern on a bytes-like object

[4973795]  multimds/thrash/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml ceph-thrash/mon.yaml clusters/9-mds-3-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{mount.yaml overrides/{distro/stock/{k-stock.yaml rhel_8.yaml} ms-die-on-skipped.yaml}} msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml}
-----------------------------------------------------------------
time:   00:12:34
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973795/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973795/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=ad79c431c63f4f2e8721bb069091fc54

    cannot use a string pattern on a bytes-like object

[4973796]  multimds/basic/{0-supported-random-distro$/{rhel_8.yaml} begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/testing/{flavor/ubuntu_latest.yaml k-testing.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
-----------------------------------------------------------------
time:   00:11:05
info:   http://pulpito.ceph.com/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973796/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-22_04:15:02-multimds-master-testing-basic-smithi/4973796/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=eac433d04eae49e39ba2e5700f371ca6

    cannot use a string pattern on a bytes-like object
2020-04-23T13:03:42.819 INFO:teuthology.results:starting coverage generation
2020-04-23T13:03:42.822 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'