2020-06-30T02:03:57.034 INFO:root:teuthology version: 1.0.0-22bcea5
2020-06-30T02:03:57.036 INFO:teuthology.results:subset: '0/8'
2020-06-30T02:03:57.036 INFO:teuthology.results:seed: '4512'
2020-06-30T09:59:18.132 INFO:root:teuthology version: 1.0.0-22bcea5
2020-06-30T09:59:18.471 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-06-30T13:39:24.564 INFO:teuthology.results:Tests finished! gathering results...
2020-06-30T13:39:41.088 INFO:scrape:Found 160 jobs
2020-06-30T13:39:44.004 INFO:scrape:Found 5 distinct failure reasons
2020-06-30T13:39:44.005 INFO:scrape:Failure: '/home/ubuntu/cephtest/archive/syslog/kern.log:2020-06-30T09:57:52.425211+00:00 smithi205 kernel: watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [kworker/7:2:25281]
' in syslog
2020-06-30T13:39:44.006 INFO:scrape:1 jobs: ['5190645']
2020-06-30T13:39:44.006 INFO:scrape:suites: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-06-30T13:39:44.007 INFO:scrape:
2020-06-30T13:39:44.007 INFO:scrape:Crash: Test failure: test_snapclient_cache (tasks.cephfs.test_snapshots.TestSnapshots)
2020-06-30T13:39:44.007 INFO:scrape:ceph version 16.0.0-3007-gbd0d251d114 (bd0d251d1148eca0e946f77d311c3cbd77f7acd4) pacific (dev)
 1: (()+0x12dc0) [0x7fda501f6dc0]
 2: (gsignal()+0x10f) [0x7fda4ecba8df]
 3: (abort()+0x127) [0x7fda4eca4cf5]
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fda516033d7]
 5: (()+0x2765a0) [0x7fda516035a0]
 6: (MDSTableClient::handle_request(boost::intrusive_ptr<MMDSTableRequest const> const&)+0x128b) [0x56011829547b]
 7: (MDSRank::handle_message(boost::intrusive_ptr<Message const> const&)+0xddc) [0x560117ff7bbc]
 8: (MDSRank::_dispatch(boost::intrusive_ptr<Message const> const&, bool)+0x7bb) [0x560117ff9deb]
 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr<Message const> const&)+0x55) [0x560117ffa3e5]
 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0x128) [0x560117fe8468]
 11: (DispatchQueue::entry()+0x126a) [0x7fda5182a11a]
 12: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda518d8c21]
 13: (()+0x82de) [0x7fda501ec2de]
 14: (clone()+0x43) [0x7fda4ed7f133]
2020-06-30T13:39:44.008 INFO:scrape:1 jobs: ['5190646']
2020-06-30T13:39:44.008 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{rhel_8}', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'q_check_counter/check_counter', 'tasks/cephfs_test_snapshots}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-06-30T13:39:44.009 INFO:scrape:
2020-06-30T13:39:44.009 INFO:scrape:Failure: Command failed on smithi043 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'
2020-06-30T13:39:44.010 INFO:scrape:2 jobs: ['5190709', '5190691']
2020-06-30T13:39:44.010 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health']
2020-06-30T13:39:44.011 INFO:scrape:suites union: ['begin', 'centos_latest', 'clusters/3-mds', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{rhel_8}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'tasks/cephfs_test_exports}', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}']
2020-06-30T13:39:44.011 INFO:scrape:
2020-06-30T13:39:44.012 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/suites/blogbench.sh
2020-06-30T13:39:44.012 INFO:scrape:1 jobs: ['5190603']
2020-06-30T13:39:44.012 INFO:scrape:suites: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'q_check_counter/check_counter', 'rhel_8}', 'tasks/cfuse_workunit_suites_blogbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-06-30T13:39:44.013 INFO:scrape:
2020-06-30T13:39:44.014 INFO:scrape:Timeout 3h running clone.client.1/qa/workunits/suites/blogbench.sh
2020-06-30T13:39:44.014 INFO:scrape:1 jobs: ['5190635']
2020-06-30T13:39:44.015 INFO:scrape:suites: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_suites_blogbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-06-30T13:39:44.015 INFO:scrape:
2020-06-30T13:39:44.025 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  154


Fail
=================================================================
[5190603]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   03:23:44
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190603/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190603/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=66895fb12bc84c7f9434946eedb14172

    Command failed (workunit test suites/blogbench.sh) on smithi082 with status
    124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=bd0d251d1148eca0e946f77d311c3cbd77f7acd4
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh'

[5190635]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   03:24:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190635/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190635/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b9ee2309657a46d1a967c1fac3aa1122

    Command failed (workunit test suites/blogbench.sh) on smithi171 with status
    124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=bd0d251d1148eca0e946f77d311c3cbd77f7acd4
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/blogbench.sh'

[5190645]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:52:44
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190645/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190645/

    '/home/ubuntu/cephtest/archive/syslog/kern.log:2020-06-30T09:57:52.425211+0
    0:00 smithi205 kernel: watchdog: BUG: soft lockup - CPU#7 stuck for 23s!
    [kworker/7:2:25281] ' in syslog

[5190646]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
-----------------------------------------------------------------
time:   00:18:41
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190646/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190646/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=eaede30d0845481bbbdfdcfdefd7da1e

    Test failure: test_snapclient_cache
    (tasks.cephfs.test_snapshots.TestSnapshots)

[5190691]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
-----------------------------------------------------------------
time:   00:04:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190691/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190691/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=589d515fea814180a4a823a9a50f90bf

    Command failed on smithi168 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-
    devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel
    libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel'

[5190709]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   00:04:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190709/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190709/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=784c8439d7b2479380d40f7dbeaa92b0

    Command failed on smithi043 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-
    object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-
    base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo
    ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo
    libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-
    debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-
    debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo
    python3-cephfs bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel'



Pass
=================================================================
[5190595] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:46:04
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190595/

[5190596] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:44
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190596/

[5190597] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:05:21
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190597/

[5190598] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:20
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190598/

[5190599] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:57:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190599/

[5190600] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190600/

[5190601] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:07:13
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190601/

[5190602] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:15:44
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190602/

[5190604] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190604/

[5190605] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:02:05
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190605/

[5190606] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:35:26
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190606/

[5190607] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:04
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190607/

[5190608] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:20
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190608/

[5190609] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:23:19
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190609/

[5190610] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:22:14
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190610/

[5190611] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:42:16
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190611/

[5190612] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:17
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190612/

[5190613] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   03:10:51
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190613/

[5190614] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:30:00
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190614/

[5190615] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:57:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190615/

[5190616] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190616/

[5190617] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:41:34
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190617/

[5190618] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:15:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190618/

[5190619] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:23:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190619/

[5190620] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190620/

[5190621] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:04:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190621/

[5190622] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:41:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190622/

[5190623] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:54
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190623/

[5190624] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:53
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190624/

[5190625] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:24:00
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190625/

[5190626] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:17:54
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190626/

[5190627] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:42:37
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190627/

[5190628] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:51
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190628/

[5190629] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:08:48
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190629/

[5190630] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:54
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190630/

[5190631] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:08:52
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190631/

[5190632] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:00
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190632/

[5190633] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:47:00
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190633/

[5190634] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:45
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190634/

[5190636] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:46
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190636/

[5190637] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:12:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190637/

[5190638] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:34:01
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190638/

[5190639] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190639/

[5190640] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:27
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190640/

[5190641] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:38:59
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190641/

[5190642] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:12:55
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190642/

[5190643] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:45:40
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190643/

[5190644] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:03
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190644/

[5190647] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:43:53
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190647/

[5190648] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:16
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190648/

[5190649] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:21:52
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190649/

[5190650] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:20:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190650/

[5190651] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:39:04
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190651/

[5190652] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190652/

[5190653] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:51:48
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190653/

[5190654] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:36:28
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190654/

[5190655] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:24:14
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190655/

[5190656] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190656/

[5190657] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:23:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190657/

[5190658] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:13:20
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190658/

[5190659] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:42:25
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190659/

[5190660] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190660/

[5190661] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   00:58:03
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190661/

[5190662] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:47
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190662/

[5190663] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:10:25
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190663/

[5190664] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:25
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190664/

[5190665] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:43:10
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190665/

[5190666] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190666/

[5190667] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:33:46
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190667/

[5190668] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:27
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190668/

[5190669] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:02:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190669/

[5190670] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:44:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190670/

[5190671] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:21:55
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190671/

[5190672] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190672/

[5190673] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:34:13
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190673/

[5190674] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:26:16
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190674/

[5190675] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:42:05
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190675/

[5190676] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:16
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190676/

[5190677] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:23:09
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190677/

[5190678] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:26:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190678/

[5190679] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:43:21
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190679/

[5190680] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:24:15
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190680/

[5190681] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:59:33
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190681/

[5190682] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:14:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190682/

[5190683] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:23:52
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190683/

[5190684] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190684/

[5190685] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:03:07
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190685/

[5190686] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:39:01
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190686/

[5190687] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:48
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190687/

[5190688] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:22:40
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190688/

[5190689] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:26:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190689/

[5190690] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:17:40
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190690/

[5190692] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:55
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190692/

[5190693] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:09:13
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190693/

[5190694] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:20:25
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190694/

[5190695] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:25:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190695/

[5190696] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:24:00
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190696/

[5190697] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:45:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190697/

[5190698] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:17:03
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190698/

[5190699] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:36:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190699/

[5190700] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190700/

[5190701] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:07:58
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190701/

[5190702] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:59:11
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190702/

[5190703] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:55
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190703/

[5190704] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:09
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190704/

[5190705] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:26:01
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190705/

[5190706] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:18:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190706/

[5190707] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:45:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190707/

[5190708] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:04
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190708/

[5190710] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:20:40
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190710/

[5190711] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:41:47
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190711/

[5190712] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:32
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190712/

[5190713] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:11:12
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190713/

[5190714] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:19:19
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190714/

[5190715] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:30:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190715/

[5190716] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190716/

[5190717] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:57:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190717/

[5190718] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:28:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190718/

[5190719] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:20:28
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190719/

[5190720] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:22:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190720/

[5190721] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:36:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190721/

[5190722] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:13:48
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190722/

[5190723] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:43:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190723/

[5190724] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:12
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190724/

[5190725] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:15:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190725/

[5190726] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:28
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190726/

[5190727] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:03:03
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190727/

[5190728] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:24:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190728/

[5190729] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:56:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190729/

[5190730] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:14:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190730/

[5190731] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:39:45
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190731/

[5190732] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:01
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190732/

[5190733] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:55:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190733/

[5190734] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:29:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190734/

[5190735] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:19:32
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190735/

[5190736] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:41
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190736/

[5190737] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:25:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190737/

[5190738] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:29:04
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190738/

[5190739] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:18
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190739/

[5190740] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190740/

[5190741] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:11:40
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190741/

[5190742] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:26:15
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190742/

[5190743] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:02:46
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190743/

[5190744] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:42
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190744/

[5190745] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:57:11
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190745/

[5190746] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:28
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190746/

[5190747] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:22:31
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190747/

[5190748] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:07
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190748/

[5190749] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:05:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190749/

[5190750] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:54:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190750/

[5190751] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:42
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190751/

[5190752] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190752/

[5190753] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:41:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190753/

[5190754] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:18:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-29_23:23:33-multimds-wip-pdonnell-testing-20200629.214056-distro-basic-smithi/5190754/