2020-06-25T01:50:34.379 INFO:root:teuthology version: 1.0.0-65507fc
2020-06-25T01:50:34.381 INFO:teuthology.results:subset: '0/8'
2020-06-25T01:50:34.381 INFO:teuthology.results:seed: '1760'
2020-06-25T04:28:56.466 INFO:root:teuthology version: 1.0.0-37e120c
2020-06-25T04:28:56.482 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-06-25T07:51:02.204 INFO:teuthology.results:Tests finished! gathering results...
2020-06-25T07:51:02.454 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/
failed:  34
dead:    0
running: 0
waiting: 0
queued:  0
passed:  126


Fail
=================================================================
[5176900]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:25:49
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176900/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176900/

    "2020-06-25T02:30:53.602584+0000 mds.c (mds.1) 1 : cluster [WRN]
    client.4614 isn't responding to mclientcaps(revoke), ino 0x100000012ae
    pending pAsLsXs issued pAsLsXsFs, sent 61.068740 seconds ago" in cluster
    log

[5176904]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   00:43:54
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176904/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176904/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=eb9e83b371c548babe20e6387c72f326

    Command failed (workunit test suites/fsstress.sh) on smithi059 with status
    2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=7b8b129cbef1ea0d2bb10d3227635eea082d34bb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

[5176909]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
-----------------------------------------------------------------
time:   00:42:33
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176909/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176909/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2d2a30539f444a4fb63fd1c6c24fcdc9

    "2020-06-25T03:09:13.822085+0000 mon.b (mon.0) 144 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176929]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:46:35
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176929/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176929/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=37bac8d18aae495e9ea633a0b200c138

    "2020-06-25T03:26:01.216052+0000 mon.a (mon.0) 213 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176937]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
-----------------------------------------------------------------
time:   00:42:09
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176937/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176937/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c084f236ac3c47e09c4a7fb51b316602

    "2020-06-25T03:18:34.938093+0000 mon.b (mon.0) 153 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176941]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
-----------------------------------------------------------------
time:   00:46:51
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176941/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176941/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c42d7185ead546989fb1f70a5341f990

    "2020-06-25T03:41:03.028203+0000 mon.b (mon.0) 187 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176942]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   00:42:47
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176942/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176942/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1ae78a671b564f4e99750199ab5f8d21

    "2020-06-25T04:34:21.616344+0000 mon.b (mon.0) 239 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176946]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:47:28
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176946/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176946/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a398252e0fe8464ea7c25f29d7fce36f

    "2020-06-25T03:38:44.798867+0000 mon.a (mon.0) 214 : cluster [WRN] Health
    check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5176948]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:42:35
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176948/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176948/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=0d9fe328598a42fc8762ee6afa15bd5c

    "2020-06-25T03:35:03.312691+0000 mon.b (mon.0) 136 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176952]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
-----------------------------------------------------------------
time:   00:02:32
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176952/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176952/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=00254cf6f9ea4f8493ee8d05684ab0a6

    Command failed on smithi059 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-
    devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel
    libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel'

[5176953]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
-----------------------------------------------------------------
time:   00:47:12
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176953/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176953/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=302016de271741358ca0070630a2e973

    "2020-06-25T03:44:51.554156+0000 mon.a (mon.0) 208 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176961]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:42:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176961/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176961/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=830bd8f10eac414a847a03c89080f38a

    "2020-06-25T03:40:34.408549+0000 mon.a (mon.0) 245 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176964]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:46:59
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176964/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176964/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=ff2a288528c24df7af022e33eb9ddb40

    "2020-06-25T04:03:32.923964+0000 mon.a (mon.0) 213 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176965]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:42:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176965/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176965/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=97a58e6d64fd48e6b00ecb142d25873d

    "2020-06-25T06:00:09.712338+0000 mon.a (mon.0) 172 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176968]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   00:59:43
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176968/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176968/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=e921987cbc7d4f1abd7272109b72c70f

    "2020-06-25T04:02:56.869025+0000 mon.a (mon.0) 297 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176969]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
-----------------------------------------------------------------
time:   00:11:48
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176969/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176969/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=eaecdd9f3c2f422587d0a533ffa887e9

    Test failure: test_kill_mdstable
    (tasks.cephfs.test_snapshots.TestSnapshots)

[5176977]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:42:45
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176977/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176977/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=119cc6289ea64f9bb53cd64163910882

    "2020-06-25T03:48:43.775787+0000 mon.b (mon.0) 151 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176980]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:41:32
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176980/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176980/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=4ff31aaa18b54411830e67b6c9cd2983

    "2020-06-25T03:49:25.803781+0000 mon.a (mon.0) 168 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5176997]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:41:54
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176997/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176997/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a549e311b7ab40fdb611a09703b8f7a1

    "2020-06-25T05:25:08.992034+0000 mon.b (mon.0) 160 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177000]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   00:58:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177000/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177000/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=15d2d75cddc84fcaa3ec07231f7271cf

    "2020-06-25T04:18:27.107587+0000 mon.a (mon.0) 260 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177001]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
-----------------------------------------------------------------
time:   00:42:46
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177001/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177001/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=876d8d1605b541a297786e2fd5659e49

    "2020-06-25T04:11:20.634347+0000 mon.a (mon.0) 167 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177004]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:47:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177004/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177004/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=bcd0c8cc06dc44678eafb1cb05fe9799

    "2020-06-25T04:22:41.200429+0000 mon.a (mon.0) 172 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177006]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   03:18:49
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177006/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177006/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5474cd944bc24e259c54760355cfe40a

    Command failed (workunit test suites/blogbench.sh) on smithi003 with status
    124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=7b8b129cbef1ea0d2bb10d3227635eea082d34bb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/blogbench.sh'

[5177011]  multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:42:18
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177011/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177011/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=3e2e321156cb4394941cb2066490da72

    "2020-06-25T04:20:32.181738+0000 mon.b (mon.0) 196 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177013]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:42:16
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177013/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177013/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=437ca415719f4d8b8a48f201cb031a7d

    "2020-06-25T04:30:34.793708+0000 mon.b (mon.0) 214 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177014]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
-----------------------------------------------------------------
time:   00:02:28
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177014/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177014/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=79cd0accfc0d4c938f8261d004448069

    Command failed on smithi036 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-
    devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel
    libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel'

[5177021]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
-----------------------------------------------------------------
time:   00:41:49
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177021/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177021/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=85085a80adf748d38e69d7c1faa6698f

    "2020-06-25T04:34:22.164883+0000 mon.b (mon.0) 137 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177022]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   00:48:05
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177022/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177022/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b393dc5436cf41998b4f0363fb8cca67

    "2020-06-25T04:29:20.784640+0000 mon.a (mon.0) 306 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177026]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:47:16
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177026/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177026/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2470b41e4ed54258a5bab70a079af43f

    "2020-06-25T04:36:46.644902+0000 mon.a (mon.0) 185 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177027]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:42:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177027/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177027/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a5e7464054ee4489ace49d73437833f1

    "2020-06-25T04:54:50.543445+0000 mon.b (mon.0) 191 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177038]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   00:41:19
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177038/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177038/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=30068d300e9243ad948b49c906f78c78

    "2020-06-25T04:41:29.402777+0000 mon.a (mon.0) 177 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177039]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:42:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177039/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177039/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c28b8f55f03f4b4e844694b62ee75447

    "2020-06-25T05:11:25.166507+0000 mon.a (mon.0) 148 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5177042]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:42:39
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177042/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177042/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=96480912eea6498fb6ce12bc13d00704

    "2020-06-25T05:23:21.423348+0000 mon.b (mon.0) 143 : cluster [WRN] Health
    check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5177044]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:41:52
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177044/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177044/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=4d0f700fec934cd58e75999a4160586d

    "2020-06-25T05:48:52.109624+0000 mon.a (mon.0) 184 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log



Pass
=================================================================
[5176886] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:12:51
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176886/

[5176887] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:43
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176887/

[5176888] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:05:52
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176888/

[5176889] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:42
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176889/

[5176890] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:53:19
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176890/

[5176891] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:03
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176891/

[5176892] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:52:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176892/

[5176893] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:14:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176893/

[5176894] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:37:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176894/

[5176895] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176895/

[5176896] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:59:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176896/

[5176897] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:34:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176897/

[5176898] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176898/

[5176899] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:07
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176899/

[5176901] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:29:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176901/

[5176902] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:14:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176902/

[5176903] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:54
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176903/

[5176905] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:25:00
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176905/

[5176906] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:05:01
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176906/

[5176907] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176907/

[5176908] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:41:45
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176908/

[5176910] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:22:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176910/

[5176911] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:17
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176911/

[5176912] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:08:15
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176912/

[5176913] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:49:50
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176913/

[5176914] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:16:33
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176914/

[5176915] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:21
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176915/

[5176916] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:30:14
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176916/

[5176917] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:17:52
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176917/

[5176918] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:13:54
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176918/

[5176919] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:53
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176919/

[5176920] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   00:59:13
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176920/

[5176921] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:26
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176921/

[5176922] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:12:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176922/

[5176923] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:16
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176923/

[5176924] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:43:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176924/

[5176925] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:26
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176925/

[5176926] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:30:47
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176926/

[5176927] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176927/

[5176928] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:09:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176928/

[5176930] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:15:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176930/

[5176931] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:32
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176931/

[5176932] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:36:44
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176932/

[5176933] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:12:39
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176933/

[5176934] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:19:43
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176934/

[5176935] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:42
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176935/

[5176936] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:58:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176936/

[5176938] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:44:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176938/

[5176939] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:55
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176939/

[5176940] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   02:07:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176940/

[5176943] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:13:53
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176943/

[5176944] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:52:05
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176944/

[5176945] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:37:08
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176945/

[5176947] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:45
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176947/

[5176949] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:13:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176949/

[5176950] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:12:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176950/

[5176951] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:20:10
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176951/

[5176954] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:07:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176954/

[5176955] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:15
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176955/

[5176956] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:55:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176956/

[5176957] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:15:21
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176957/

[5176958] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:37:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176958/

[5176959] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:52
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176959/

[5176960] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:56:50
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176960/

[5176962] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:21:44
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176962/

[5176963] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:19
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176963/

[5176966] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:15:50
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176966/

[5176967] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176967/

[5176970] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:46:39
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176970/

[5176971] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:25:09
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176971/

[5176972] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:04:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176972/

[5176973] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:13:31
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176973/

[5176974] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:28:47
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176974/

[5176975] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:29
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176975/

[5176976] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:05:50
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176976/

[5176978] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:10
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176978/

[5176979] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:46
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176979/

[5176981] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:16:28
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176981/

[5176982] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:13:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176982/

[5176983] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:11:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176983/

[5176984] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:11:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176984/

[5176985] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:48
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176985/

[5176986] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:20:19
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176986/

[5176987] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:24:13
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176987/

[5176988] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:42:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176988/

[5176989] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:13:45
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176989/

[5176990] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:38:56
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176990/

[5176991] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:26
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176991/

[5176992] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:52:10
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176992/

[5176993] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   02:01:57
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176993/

[5176994] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:15:43
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176994/

[5176995] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176995/

[5176996] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:24:39
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176996/

[5176998] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:18:47
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176998/

[5176999] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:11
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5176999/

[5177002] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:40:45
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177002/

[5177003] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:22
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177003/

[5177005] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:19:25
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177005/

[5177007] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:49
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177007/

[5177008] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:52:58
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177008/

[5177009] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:28:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177009/

[5177010] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:21:41
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177010/

[5177012] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:36:36
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177012/

[5177015] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:11:03
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177015/

[5177016] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:07:51
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177016/

[5177017] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:11
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177017/

[5177018] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:50:06
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177018/

[5177019] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:34
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177019/

[5177020] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:14:17
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177020/

[5177023] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:12
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177023/

[5177024] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:53:44
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177024/

[5177025] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:27:59
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177025/

[5177028] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:26:32
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177028/

[5177029] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:13:02
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177029/

[5177030] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:14:23
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177030/

[5177031] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:34
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177031/

[5177032] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:01:11
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177032/

[5177033] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:25:33
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177033/

[5177034] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:03:46
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177034/

[5177035] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:24
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177035/

[5177036] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:49:35
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177036/

[5177037] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:53
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177037/

[5177040] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:03:59
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177040/

[5177041] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:43:38
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177041/

[5177043] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:34
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177043/

[5177045] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:16:25
info:   http://pulpito.ceph.com/pdonnell-2020-06-24_22:51:53-multimds-wip-pdonnell-testing-20200624.212840-distro-basic-smithi/5177045/